2023-02-07 15:02:47,083 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-07 15:02:47,129 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=166, AvailableMemoryMB=6914 2023-02-07 15:02:47,416 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d 2023-02-07 15:02:47,424 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 15:02:47,424 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e, deleteOnExit=true 2023-02-07 15:02:47,425 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 15:02:47,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/test.cache.data in system properties and HBase conf 2023-02-07 15:02:47,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 15:02:47,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop.log.dir in system properties and HBase conf 2023-02-07 15:02:47,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 15:02:47,428 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 15:02:47,428 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 15:02:47,530 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-07 15:02:47,979 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 15:02:47,984 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:02:47,984 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:02:47,984 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 15:02:47,985 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:02:47,985 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 15:02:47,985 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 15:02:47,985 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:02:47,986 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:02:47,986 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 15:02:47,986 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/nfs.dump.dir in system properties and HBase conf 2023-02-07 15:02:47,986 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/java.io.tmpdir in system properties and HBase conf 2023-02-07 15:02:47,987 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:02:47,987 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 15:02:47,987 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 15:02:48,464 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:02:48,468 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:02:48,741 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-07 15:02:48,907 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-07 15:02:48,919 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:02:48,956 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:02:48,994 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/java.io.tmpdir/Jetty_localhost_41355_hdfs____4x0n4w/webapp 2023-02-07 15:02:49,136 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41355 2023-02-07 15:02:49,148 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:02:49,148 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:02:49,641 WARN [Listener at localhost/44653] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:02:49,730 WARN [Listener at localhost/44653] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:02:49,750 WARN [Listener at localhost/44653] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:02:49,756 INFO [Listener at localhost/44653] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:02:49,761 INFO [Listener at localhost/44653] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/java.io.tmpdir/Jetty_localhost_44061_datanode____.4mcysu/webapp 2023-02-07 15:02:49,870 INFO [Listener at localhost/44653] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44061 2023-02-07 15:02:50,399 WARN [Listener at localhost/44641] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:02:50,492 WARN [Listener at localhost/44641] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:02:50,509 WARN [Listener at localhost/44641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:02:50,511 INFO [Listener at localhost/44641] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:02:50,517 INFO [Listener at localhost/44641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/java.io.tmpdir/Jetty_localhost_43045_datanode____14uq49/webapp 2023-02-07 15:02:50,640 INFO [Listener at localhost/44641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43045 2023-02-07 15:02:50,652 WARN [Listener at localhost/42259] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:02:50,953 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd65be267d361218a: Processing first storage report for DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e from datanode 8c372b3a-7000-4249-9627-09a4ec181266 2023-02-07 15:02:50,955 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd65be267d361218a: from storage DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e node DatanodeRegistration(127.0.0.1:33373, datanodeUuid=8c372b3a-7000-4249-9627-09a4ec181266, infoPort=34271, infoSecurePort=0, ipcPort=44641, storageInfo=lv=-57;cid=testClusterID;nsid=1245665802;c=1675782168533), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-07 15:02:50,955 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1f5e7ffe764ae8c0: Processing first storage report for DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7 from datanode a78f2282-a588-4ca0-8541-762bf0e2a927 2023-02-07 15:02:50,955 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1f5e7ffe764ae8c0: from storage DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7 node DatanodeRegistration(127.0.0.1:36101, datanodeUuid=a78f2282-a588-4ca0-8541-762bf0e2a927, infoPort=46015, infoSecurePort=0, ipcPort=42259, storageInfo=lv=-57;cid=testClusterID;nsid=1245665802;c=1675782168533), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:02:50,955 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd65be267d361218a: Processing first storage report for DS-276e234b-429f-47b9-9c9c-d14baa0ebb3f from datanode 8c372b3a-7000-4249-9627-09a4ec181266 2023-02-07 15:02:50,956 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd65be267d361218a: from storage DS-276e234b-429f-47b9-9c9c-d14baa0ebb3f node DatanodeRegistration(127.0.0.1:33373, datanodeUuid=8c372b3a-7000-4249-9627-09a4ec181266, infoPort=34271, infoSecurePort=0, ipcPort=44641, storageInfo=lv=-57;cid=testClusterID;nsid=1245665802;c=1675782168533), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 15:02:50,956 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1f5e7ffe764ae8c0: Processing first storage report for DS-9e54e4fd-bc18-4e31-aa4c-117f35bb86b4 from datanode a78f2282-a588-4ca0-8541-762bf0e2a927 2023-02-07 15:02:50,956 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1f5e7ffe764ae8c0: from storage DS-9e54e4fd-bc18-4e31-aa4c-117f35bb86b4 node DatanodeRegistration(127.0.0.1:36101, datanodeUuid=a78f2282-a588-4ca0-8541-762bf0e2a927, infoPort=46015, infoSecurePort=0, ipcPort=42259, storageInfo=lv=-57;cid=testClusterID;nsid=1245665802;c=1675782168533), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:02:51,093 DEBUG [Listener at localhost/42259] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d 2023-02-07 15:02:51,192 INFO [Listener at localhost/42259] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e/zookeeper_0, clientPort=50408, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 15:02:51,207 INFO [Listener at localhost/42259] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50408 2023-02-07 15:02:51,215 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:51,217 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:51,880 INFO [Listener at localhost/42259] util.FSUtils(479): Created version file at hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71 with version=8 2023-02-07 15:02:51,880 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:51,882 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:51,884 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/hbase-staging 2023-02-07 15:02:52,257 INFO [Listener at localhost/42259] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-07 15:02:52,777 INFO [Listener at localhost/42259] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:02:52,810 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:52,810 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:52,811 INFO [Listener at localhost/42259] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:02:52,811 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:52,811 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:02:52,956 INFO [Listener at localhost/42259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:02:53,033 DEBUG [Listener at localhost/42259] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-07 15:02:53,127 INFO [Listener at localhost/42259] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34131 2023-02-07 15:02:53,138 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:53,140 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:53,163 INFO [Listener at localhost/42259] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34131 connecting to ZooKeeper ensemble=127.0.0.1:50408 2023-02-07 15:02:53,208 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:341310x0, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:02:53,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34131-0x1002f4e93e20000 connected 2023-02-07 15:02:53,235 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:02:53,236 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:02:53,240 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:02:53,247 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34131 2023-02-07 15:02:53,248 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34131 2023-02-07 15:02:53,248 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34131 2023-02-07 15:02:53,249 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34131 2023-02-07 15:02:53,250 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34131 2023-02-07 15:02:53,258 INFO [Listener at localhost/42259] master.HMaster(439): hbase.rootdir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71, hbase.cluster.distributed=false 2023-02-07 15:02:53,333 INFO [Listener at localhost/42259] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:02:53,334 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:53,334 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:53,334 INFO [Listener at localhost/42259] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:02:53,335 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:53,335 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:02:53,340 INFO [Listener at localhost/42259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:02:53,343 INFO [Listener at localhost/42259] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38637 2023-02-07 15:02:53,345 INFO [Listener at localhost/42259] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:02:53,353 DEBUG [Listener at localhost/42259] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:02:53,354 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:53,357 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:53,360 INFO [Listener at localhost/42259] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38637 connecting to ZooKeeper ensemble=127.0.0.1:50408 2023-02-07 15:02:53,365 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:386370x0, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:02:53,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38637-0x1002f4e93e20001 connected 2023-02-07 15:02:53,366 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:02:53,367 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:02:53,368 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:02:53,369 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38637 2023-02-07 15:02:53,370 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38637 2023-02-07 15:02:53,370 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38637 2023-02-07 15:02:53,371 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38637 2023-02-07 15:02:53,371 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38637 2023-02-07 15:02:53,384 INFO [Listener at localhost/42259] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:02:53,384 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:53,384 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:53,385 INFO [Listener at localhost/42259] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:02:53,385 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:02:53,385 INFO [Listener at localhost/42259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:02:53,386 INFO [Listener at localhost/42259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:02:53,388 INFO [Listener at localhost/42259] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36137 2023-02-07 15:02:53,388 INFO [Listener at localhost/42259] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:02:53,390 DEBUG [Listener at localhost/42259] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:02:53,391 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:53,393 INFO [Listener at localhost/42259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:53,396 INFO [Listener at localhost/42259] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36137 connecting to ZooKeeper ensemble=127.0.0.1:50408 2023-02-07 15:02:53,402 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:361370x0, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:02:53,403 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): regionserver:361370x0, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:02:53,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36137-0x1002f4e93e20002 connected 2023-02-07 15:02:53,404 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:02:53,405 DEBUG [Listener at localhost/42259] zookeeper.ZKUtil(164): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:02:53,405 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36137 2023-02-07 15:02:53,405 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36137 2023-02-07 15:02:53,406 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36137 2023-02-07 15:02:53,408 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36137 2023-02-07 15:02:53,409 DEBUG [Listener at localhost/42259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36137 2023-02-07 15:02:53,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:53,422 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:02:53,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:53,443 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:02:53,443 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:02:53,443 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:02:53,443 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:53,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:02:53,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34131,1675782172075 from backup master directory 2023-02-07 15:02:53,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:02:53,449 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:53,449 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:02:53,450 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:02:53,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:53,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-07 15:02:53,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-07 15:02:53,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/hbase.id with ID: 4b4d96c2-9aee-4e09-b828-1f4a13c46ced 2023-02-07 15:02:53,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:02:53,595 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:53,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x66cf3e17 to 127.0.0.1:50408 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:02:53,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fce1ad5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:02:53,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:02:53,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 15:02:53,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-07 15:02:53,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-07 15:02:53,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 15:02:53,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 15:02:53,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:02:53,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store-tmp 2023-02-07 15:02:53,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:53,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:02:53,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:02:53,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:02:53,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:02:53,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:02:53,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:02:53,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782173803Disabling compacts and flushes for region at 1675782173803Disabling writes for close at 1675782173804 (+1 ms)Writing region close event to WAL at 1675782173804Closed at 1675782173804 2023-02-07 15:02:53,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/WALs/jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:53,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34131%2C1675782172075, suffix=, logDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/WALs/jenkins-hbase4.apache.org,34131,1675782172075, archiveDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/oldWALs, maxLogs=10 2023-02-07 15:02:53,889 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK] 2023-02-07 15:02:53,889 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK] 2023-02-07 15:02:53,897 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-07 15:02:53,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/WALs/jenkins-hbase4.apache.org,34131,1675782172075/jenkins-hbase4.apache.org%2C34131%2C1675782172075.1675782173837 2023-02-07 15:02:53,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK], DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK]] 2023-02-07 15:02:53,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:02:53,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:53,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:02:53,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:02:54,029 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:02:54,036 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 15:02:54,063 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 15:02:54,076 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:54,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:02:54,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:02:54,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:02:54,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:54,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64854315, jitterRate=-0.03359539806842804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:02:54,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675782173998Initializing all the Stores at 1675782174000 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782174001 (+1 ms)Cleaning up temporary data from old regions at 1675782174089 (+88 ms)Cleaning up detritus from prior splits at 1675782174090 (+1 ms)Region opened successfully at 1675782174102 (+12 ms) 2023-02-07 15:02:54,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 15:02:54,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 15:02:54,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 15:02:54,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 15:02:54,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-07 15:02:54,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-02-07 15:02:54,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 15:02:54,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 15:02:54,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 15:02:54,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 15:02:54,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 15:02:54,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 15:02:54,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 15:02:54,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 15:02:54,249 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:54,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 15:02:54,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 15:02:54,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 15:02:54,269 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:02:54,269 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:02:54,269 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:02:54,269 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:54,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,34131,1675782172075, sessionid=0x1002f4e93e20000, setting cluster-up flag (Was=false) 2023-02-07 15:02:54,289 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:54,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 15:02:54,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:54,302 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:54,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 15:02:54,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:54,318 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.hbase-snapshot/.tmp 2023-02-07 15:02:54,416 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(952): ClusterId : 4b4d96c2-9aee-4e09-b828-1f4a13c46ced 2023-02-07 15:02:54,416 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(952): ClusterId : 4b4d96c2-9aee-4e09-b828-1f4a13c46ced 2023-02-07 15:02:54,422 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:02:54,422 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:02:54,428 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:02:54,428 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:02:54,428 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:02:54,428 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:02:54,432 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:02:54,433 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:02:54,434 DEBUG [RS:0;jenkins-hbase4:38637] zookeeper.ReadOnlyZKClient(139): Connect 0x339bcf31 to 127.0.0.1:50408 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:02:54,434 DEBUG [RS:1;jenkins-hbase4:36137] zookeeper.ReadOnlyZKClient(139): Connect 0x08da14d2 to 127.0.0.1:50408 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:02:54,442 DEBUG [RS:1;jenkins-hbase4:36137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61dfbb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:02:54,443 DEBUG [RS:0;jenkins-hbase4:38637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f4f835b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:02:54,443 DEBUG [RS:1;jenkins-hbase4:36137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2227fa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:02:54,443 DEBUG [RS:0;jenkins-hbase4:38637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5af0c6d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:02:54,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 15:02:54,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:02:54,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:02:54,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:02:54,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:02:54,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 15:02:54,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:02:54,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675782204462 2023-02-07 15:02:54,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 15:02:54,470 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:02:54,471 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36137 2023-02-07 15:02:54,471 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 15:02:54,472 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38637 2023-02-07 15:02:54,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 15:02:54,477 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:02:54,477 INFO [RS:1;jenkins-hbase4:36137] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:02:54,477 INFO [RS:0;jenkins-hbase4:38637] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:02:54,478 INFO [RS:0;jenkins-hbase4:38637] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:02:54,478 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:02:54,478 INFO [RS:1;jenkins-hbase4:36137] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:02:54,479 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:02:54,481 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34131,1675782172075 with isa=jenkins-hbase4.apache.org/172.31.14.131:36137, startcode=1675782173383 2023-02-07 15:02:54,481 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34131,1675782172075 with isa=jenkins-hbase4.apache.org/172.31.14.131:38637, startcode=1675782173332 2023-02-07 15:02:54,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 15:02:54,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 15:02:54,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 15:02:54,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 15:02:54,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 15:02:54,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 15:02:54,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 15:02:54,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 15:02:54,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 15:02:54,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782174498,5,FailOnTimeoutGroup] 2023-02-07 15:02:54,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782174498,5,FailOnTimeoutGroup] 2023-02-07 15:02:54,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 15:02:54,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,503 DEBUG [RS:0;jenkins-hbase4:38637] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:02:54,503 DEBUG [RS:1;jenkins-hbase4:36137] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:02:54,519 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:02:54,520 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:02:54,520 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71 2023-02-07 15:02:54,558 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:54,561 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:02:54,565 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/info 2023-02-07 15:02:54,566 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:02:54,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:54,568 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:02:54,570 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:02:54,571 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:02:54,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:54,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:02:54,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/table 2023-02-07 15:02:54,575 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:02:54,575 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:54,576 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58151, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:02:54,575 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39883, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:02:54,577 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740 2023-02-07 15:02:54,578 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740 2023-02-07 15:02:54,582 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:02:54,585 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:02:54,589 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:54,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34131] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:54,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:54,591 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65710910, jitterRate=-0.020831137895584106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:02:54,591 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675782174559Initializing all the Stores at 1675782174560 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782174561 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782174561Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782174561Cleaning up temporary data from old regions at 1675782174580 (+19 ms)Cleaning up detritus from prior splits at 1675782174581 (+1 ms)Region opened successfully at 1675782174591 (+10 ms) 2023-02-07 15:02:54,592 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:02:54,592 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:02:54,592 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:02:54,592 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:02:54,592 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:02:54,593 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:02:54,593 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782174592Disabling compacts and flushes for region at 1675782174592Disabling writes for close at 1675782174592Writing region close event to WAL at 1675782174593 (+1 ms)Closed at 1675782174593 2023-02-07 15:02:54,599 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:02:54,599 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 15:02:54,607 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71 2023-02-07 15:02:54,607 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71 2023-02-07 15:02:54,608 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44653 2023-02-07 15:02:54,608 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44653 2023-02-07 15:02:54,608 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:02:54,608 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:02:54,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 15:02:54,617 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:02:54,617 DEBUG [RS:1;jenkins-hbase4:36137] zookeeper.ZKUtil(162): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:54,617 DEBUG [RS:0;jenkins-hbase4:38637] zookeeper.ZKUtil(162): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:54,618 WARN [RS:1;jenkins-hbase4:36137] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:02:54,618 WARN [RS:0;jenkins-hbase4:38637] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:02:54,618 INFO [RS:1;jenkins-hbase4:36137] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:02:54,618 INFO [RS:0;jenkins-hbase4:38637] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:02:54,619 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:54,619 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:54,619 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38637,1675782173332] 2023-02-07 15:02:54,620 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36137,1675782173383] 2023-02-07 15:02:54,631 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 15:02:54,635 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 15:02:54,635 DEBUG [RS:0;jenkins-hbase4:38637] zookeeper.ZKUtil(162): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:54,635 DEBUG [RS:1;jenkins-hbase4:36137] zookeeper.ZKUtil(162): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:54,636 DEBUG [RS:1;jenkins-hbase4:36137] zookeeper.ZKUtil(162): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:54,636 DEBUG [RS:0;jenkins-hbase4:38637] zookeeper.ZKUtil(162): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:54,648 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:02:54,648 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:02:54,658 INFO [RS:1;jenkins-hbase4:36137] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:02:54,658 INFO [RS:0;jenkins-hbase4:38637] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:02:54,678 INFO [RS:0;jenkins-hbase4:38637] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:02:54,678 INFO [RS:1;jenkins-hbase4:36137] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:02:54,682 INFO [RS:1;jenkins-hbase4:36137] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:02:54,682 INFO [RS:0;jenkins-hbase4:38637] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:02:54,682 INFO [RS:1;jenkins-hbase4:36137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,683 INFO [RS:0;jenkins-hbase4:38637] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,683 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:02:54,683 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:02:54,692 INFO [RS:0;jenkins-hbase4:38637] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,692 INFO [RS:1;jenkins-hbase4:36137] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,693 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,693 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:02:54,694 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:02:54,694 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:0;jenkins-hbase4:38637] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,694 DEBUG [RS:1;jenkins-hbase4:36137] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:02:54,697 INFO [RS:0;jenkins-hbase4:38637] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,697 INFO [RS:0;jenkins-hbase4:38637] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,697 INFO [RS:1;jenkins-hbase4:36137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,697 INFO [RS:0;jenkins-hbase4:38637] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,697 INFO [RS:1;jenkins-hbase4:36137] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,697 INFO [RS:1;jenkins-hbase4:36137] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,713 INFO [RS:0;jenkins-hbase4:38637] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:02:54,713 INFO [RS:1;jenkins-hbase4:36137] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:02:54,718 INFO [RS:1;jenkins-hbase4:36137] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36137,1675782173383-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,718 INFO [RS:0;jenkins-hbase4:38637] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38637,1675782173332-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:54,740 INFO [RS:0;jenkins-hbase4:38637] regionserver.Replication(203): jenkins-hbase4.apache.org,38637,1675782173332 started 2023-02-07 15:02:54,740 INFO [RS:1;jenkins-hbase4:36137] regionserver.Replication(203): jenkins-hbase4.apache.org,36137,1675782173383 started 2023-02-07 15:02:54,740 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38637,1675782173332, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38637, sessionid=0x1002f4e93e20001 2023-02-07 15:02:54,740 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36137,1675782173383, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36137, sessionid=0x1002f4e93e20002 2023-02-07 15:02:54,740 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:02:54,740 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:02:54,740 DEBUG [RS:1;jenkins-hbase4:36137] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:54,741 DEBUG [RS:0;jenkins-hbase4:38637] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:54,741 DEBUG [RS:1;jenkins-hbase4:36137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36137,1675782173383' 2023-02-07 15:02:54,741 DEBUG [RS:0;jenkins-hbase4:38637] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38637,1675782173332' 2023-02-07 15:02:54,742 DEBUG [RS:0;jenkins-hbase4:38637] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:02:54,742 DEBUG [RS:1;jenkins-hbase4:36137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:02:54,743 DEBUG [RS:0;jenkins-hbase4:38637] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:02:54,743 DEBUG [RS:1;jenkins-hbase4:36137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:02:54,744 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:02:54,744 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:02:54,744 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:02:54,744 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:02:54,744 DEBUG [RS:0;jenkins-hbase4:38637] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:54,744 DEBUG [RS:1;jenkins-hbase4:36137] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:54,744 DEBUG [RS:1;jenkins-hbase4:36137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36137,1675782173383' 2023-02-07 15:02:54,744 DEBUG [RS:0;jenkins-hbase4:38637] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38637,1675782173332' 2023-02-07 15:02:54,745 DEBUG [RS:0;jenkins-hbase4:38637] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:02:54,745 DEBUG [RS:1;jenkins-hbase4:36137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:02:54,745 DEBUG [RS:0;jenkins-hbase4:38637] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:02:54,745 DEBUG [RS:1;jenkins-hbase4:36137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:02:54,746 DEBUG [RS:0;jenkins-hbase4:38637] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:02:54,746 DEBUG [RS:1;jenkins-hbase4:36137] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:02:54,746 INFO [RS:0;jenkins-hbase4:38637] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:02:54,746 INFO [RS:1;jenkins-hbase4:36137] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:02:54,747 INFO [RS:0;jenkins-hbase4:38637] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:02:54,747 INFO [RS:1;jenkins-hbase4:36137] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:02:54,787 DEBUG [jenkins-hbase4:34131] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 15:02:54,793 DEBUG [jenkins-hbase4:34131] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:02:54,800 DEBUG [jenkins-hbase4:34131] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:02:54,801 DEBUG [jenkins-hbase4:34131] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:02:54,801 DEBUG [jenkins-hbase4:34131] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:02:54,804 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36137,1675782173383, state=OPENING 2023-02-07 15:02:54,813 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 15:02:54,814 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:54,815 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:02:54,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:02:55,005 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:55,007 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:02:55,010 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37378, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:02:55,023 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 15:02:55,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:02:55,027 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36137%2C1675782173383.meta, suffix=.meta, logDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,36137,1675782173383, archiveDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/oldWALs, maxLogs=32 2023-02-07 15:02:55,051 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK] 2023-02-07 15:02:55,051 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK] 2023-02-07 15:02:55,056 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,36137,1675782173383/jenkins-hbase4.apache.org%2C36137%2C1675782173383.meta.1675782175031.meta 2023-02-07 15:02:55,056 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK], DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK]] 2023-02-07 15:02:55,057 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:02:55,059 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 15:02:55,081 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 15:02:55,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 15:02:55,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 15:02:55,092 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:55,092 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 15:02:55,092 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 15:02:55,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:02:55,097 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/info 2023-02-07 15:02:55,097 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/info 2023-02-07 15:02:55,098 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:02:55,098 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:55,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:02:55,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:02:55,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:02:55,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:02:55,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:55,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:02:55,103 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/table 2023-02-07 15:02:55,103 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/table 2023-02-07 15:02:55,104 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:02:55,104 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:55,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740 2023-02-07 15:02:55,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740 2023-02-07 15:02:55,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:02:55,118 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:02:55,120 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72769824, jitterRate=0.08435487747192383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:02:55,120 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675782175092Writing region info on filesystem at 1675782175092Initializing all the Stores at 1675782175094 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782175094Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782175095 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782175095Cleaning up temporary data from old regions at 1675782175112 (+17 ms)Cleaning up detritus from prior splits at 1675782175113 (+1 ms)Running coprocessor post-open hooks at 1675782175120 (+7 ms)Region opened successfully at 1675782175120 2023-02-07 15:02:55,134 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675782174997 2023-02-07 15:02:55,158 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36137,1675782173383, state=OPEN 2023-02-07 15:02:55,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 15:02:55,161 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 15:02:55,164 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 15:02:55,165 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:02:55,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 15:02:55,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36137,1675782173383 in 345 msec 2023-02-07 15:02:55,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 15:02:55,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 559 msec 2023-02-07 15:02:55,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 806 msec 2023-02-07 15:02:55,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675782173439, completionTime=-1 2023-02-07 15:02:55,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 15:02:55,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 15:02:55,254 DEBUG [hconnection-0x29b733fc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:02:55,257 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:02:55,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 15:02:55,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675782235273 2023-02-07 15:02:55,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675782295273 2023-02-07 15:02:55,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 90 msec 2023-02-07 15:02:55,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34131,1675782172075-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:55,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34131,1675782172075-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:55,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34131,1675782172075-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:55,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34131, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:55,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 15:02:55,311 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 15:02:55,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 15:02:55,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:02:55,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 15:02:55,338 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:02:55,341 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:02:55,365 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,367 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849 empty. 2023-02-07 15:02:55,368 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,368 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 15:02:55,398 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 15:02:55,400 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4286137d1e0b0c442ce2434a967d8849, NAME => 'hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:55,419 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:55,419 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4286137d1e0b0c442ce2434a967d8849, disabling compactions & flushes 2023-02-07 15:02:55,420 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:02:55,420 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:02:55,420 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. after waiting 0 ms 2023-02-07 15:02:55,420 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:02:55,420 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:02:55,420 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4286137d1e0b0c442ce2434a967d8849: Waiting for close lock at 1675782175419Disabling compacts and flushes for region at 1675782175419Disabling writes for close at 1675782175420 (+1 ms)Writing region close event to WAL at 1675782175420Closed at 1675782175420 2023-02-07 15:02:55,425 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:02:55,439 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782175427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782175427"}]},"ts":"1675782175427"} 2023-02-07 15:02:55,468 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:02:55,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:02:55,474 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782175470"}]},"ts":"1675782175470"} 2023-02-07 15:02:55,478 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 15:02:55,483 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:02:55,485 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:02:55,485 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:02:55,485 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:02:55,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4286137d1e0b0c442ce2434a967d8849, ASSIGN}] 2023-02-07 15:02:55,490 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4286137d1e0b0c442ce2434a967d8849, ASSIGN 2023-02-07 15:02:55,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4286137d1e0b0c442ce2434a967d8849, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38637,1675782173332; forceNewPlan=false, retain=false 2023-02-07 15:02:55,647 INFO [jenkins-hbase4:34131] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:02:55,648 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4286137d1e0b0c442ce2434a967d8849, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:55,648 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782175647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782175647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782175647"}]},"ts":"1675782175647"} 2023-02-07 15:02:55,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4286137d1e0b0c442ce2434a967d8849, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:02:55,758 INFO [RS:0;jenkins-hbase4:38637] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38637%2C1675782173332, suffix=, logDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,38637,1675782173332, archiveDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/oldWALs, maxLogs=32 2023-02-07 15:02:55,758 INFO [RS:1;jenkins-hbase4:36137] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36137%2C1675782173383, suffix=, logDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,36137,1675782173383, archiveDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/oldWALs, maxLogs=32 2023-02-07 15:02:55,786 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK] 2023-02-07 15:02:55,786 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK] 2023-02-07 15:02:55,787 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK] 2023-02-07 15:02:55,787 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK] 2023-02-07 15:02:55,793 INFO [RS:1;jenkins-hbase4:36137] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,36137,1675782173383/jenkins-hbase4.apache.org%2C36137%2C1675782173383.1675782175760 2023-02-07 15:02:55,793 INFO [RS:0;jenkins-hbase4:38637] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/WALs/jenkins-hbase4.apache.org,38637,1675782173332/jenkins-hbase4.apache.org%2C38637%2C1675782173332.1675782175760 2023-02-07 15:02:55,796 DEBUG [RS:1;jenkins-hbase4:36137] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK], DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK]] 2023-02-07 15:02:55,796 DEBUG [RS:0;jenkins-hbase4:38637] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36101,DS-9c9b3c68-13b8-4bb4-a0fe-f77eb1e314f7,DISK], DatanodeInfoWithStorage[127.0.0.1:33373,DS-c7693efa-b5b3-4641-89df-0d41af1dcf3e,DISK]] 2023-02-07 15:02:55,808 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:55,808 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:02:55,812 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38034, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:02:55,821 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:02:55,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4286137d1e0b0c442ce2434a967d8849, NAME => 'hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:02:55,823 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,824 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:55,824 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,824 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,827 INFO [StoreOpener-4286137d1e0b0c442ce2434a967d8849-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,829 DEBUG [StoreOpener-4286137d1e0b0c442ce2434a967d8849-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/info 2023-02-07 15:02:55,829 DEBUG [StoreOpener-4286137d1e0b0c442ce2434a967d8849-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/info 2023-02-07 15:02:55,830 INFO [StoreOpener-4286137d1e0b0c442ce2434a967d8849-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4286137d1e0b0c442ce2434a967d8849 columnFamilyName info 2023-02-07 15:02:55,831 INFO [StoreOpener-4286137d1e0b0c442ce2434a967d8849-1] regionserver.HStore(310): Store=4286137d1e0b0c442ce2434a967d8849/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:55,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:02:55,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:55,846 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4286137d1e0b0c442ce2434a967d8849; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72264596, jitterRate=0.07682639360427856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:02:55,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4286137d1e0b0c442ce2434a967d8849: Running coprocessor pre-open hook at 1675782175824Writing region info on filesystem at 1675782175824Initializing all the Stores at 1675782175826 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782175826Cleaning up temporary data from old regions at 1675782175835 (+9 ms)Cleaning up detritus from prior splits at 1675782175836 (+1 ms)Running coprocessor post-open hooks at 1675782175846 (+10 ms)Region opened successfully at 1675782175846 2023-02-07 15:02:55,848 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849., pid=6, masterSystemTime=1675782175808 2023-02-07 15:02:55,854 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:02:55,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:02:55,856 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4286137d1e0b0c442ce2434a967d8849, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:55,856 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782175855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782175855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782175855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782175855"}]},"ts":"1675782175855"} 2023-02-07 15:02:55,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 15:02:55,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4286137d1e0b0c442ce2434a967d8849, server=jenkins-hbase4.apache.org,38637,1675782173332 in 208 msec 2023-02-07 15:02:55,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 15:02:55,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4286137d1e0b0c442ce2434a967d8849, ASSIGN in 378 msec 2023-02-07 15:02:55,870 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:02:55,870 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782175870"}]},"ts":"1675782175870"} 2023-02-07 15:02:55,873 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 15:02:55,876 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:02:55,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 550 msec 2023-02-07 15:02:55,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 15:02:55,939 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:02:55,939 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:02:55,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:02:55,966 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38048, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:02:55,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 15:02:56,004 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:02:56,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-02-07 15:02:56,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 15:02:56,031 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:02:56,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-07 15:02:56,046 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 15:02:56,048 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 15:02:56,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.599sec 2023-02-07 15:02:56,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 15:02:56,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 15:02:56,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 15:02:56,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34131,1675782172075-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 15:02:56,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34131,1675782172075-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 15:02:56,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 15:02:56,121 DEBUG [Listener at localhost/42259] zookeeper.ReadOnlyZKClient(139): Connect 0x5f75bdf0 to 127.0.0.1:50408 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:02:56,126 DEBUG [Listener at localhost/42259] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56ed376c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:02:56,171 DEBUG [hconnection-0x4d22e124-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:02:56,182 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:02:56,192 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:02:56,193 DEBUG [Listener at localhost/42259] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 15:02:56,194 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:56,195 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:56,202 DEBUG [Listener at localhost/42259] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 15:02:56,205 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46492, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 15:02:56,209 INFO [Listener at localhost/42259] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 15:02:56,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 15:02:56,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 15:02:56,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:46492 deadline: 1675782236213, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 15:02:56,231 INFO [Listener at localhost/42259] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 15:02:56,233 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:56,233 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:56,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:02:56,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 15:02:56,280 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:02:56,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:02:56,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 15:02:56,301 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:56,301 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:56,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:02:56,328 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:56,344 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6 empty. 2023-02-07 15:02:56,344 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:56,358 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f empty. 2023-02-07 15:02:56,358 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:56,359 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:56,368 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,375 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882 empty. 2023-02-07 15:02:56,375 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506 2023-02-07 15:02:56,375 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468 2023-02-07 15:02:56,375 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:56,375 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,376 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:56,376 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:56,376 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:56,376 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,377 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648 empty. 2023-02-07 15:02:56,377 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468 empty. 2023-02-07 15:02:56,377 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada empty. 2023-02-07 15:02:56,377 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e empty. 2023-02-07 15:02:56,377 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506 empty. 2023-02-07 15:02:56,378 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468 2023-02-07 15:02:56,378 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:56,378 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:56,378 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb empty. 2023-02-07 15:02:56,378 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e empty. 2023-02-07 15:02:56,378 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506 2023-02-07 15:02:56,378 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,380 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:56,380 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:56,380 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 15:02:56,408 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 15:02:56,410 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4ed09922affb2fb864cd044e82f5a882, NAME => 'testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,411 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e146a9e07ae15a7e4bc579f6ea4489d6, NAME => 'testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,411 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9f98b7b6c1c5a5a713d1b5bd16fc712f, NAME => 'testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,413 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:56,414 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:56,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:02:56,455 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,455 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4ed09922affb2fb864cd044e82f5a882, disabling compactions & flushes 2023-02-07 15:02:56,455 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:56,455 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:56,455 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. after waiting 0 ms 2023-02-07 15:02:56,455 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:56,455 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:56,456 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4ed09922affb2fb864cd044e82f5a882: Waiting for close lock at 1675782176455Disabling compacts and flushes for region at 1675782176455Disabling writes for close at 1675782176455Writing region close event to WAL at 1675782176455Closed at 1675782176455 2023-02-07 15:02:56,456 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3be527e2e29ec8ca9ea716b0c125138e, NAME => 'testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 9f98b7b6c1c5a5a713d1b5bd16fc712f, disabling compactions & flushes 2023-02-07 15:02:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,463 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e146a9e07ae15a7e4bc579f6ea4489d6, disabling compactions & flushes 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:56,464 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. after waiting 0 ms 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. after waiting 0 ms 2023-02-07 15:02:56,464 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: Waiting for close lock at 1675782176463Disabling compacts and flushes for region at 1675782176463Disabling writes for close at 1675782176464 (+1 ms)Writing region close event to WAL at 1675782176464Closed at 1675782176464 2023-02-07 15:02:56,464 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:56,465 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e146a9e07ae15a7e4bc579f6ea4489d6: Waiting for close lock at 1675782176464Disabling compacts and flushes for region at 1675782176464Disabling writes for close at 1675782176464Writing region close event to WAL at 1675782176464Closed at 1675782176464 2023-02-07 15:02:56,465 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8732006a08753896dec326564ce25506, NAME => 'testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,466 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9ef9bad482199871438184433fc8a468, NAME => 'testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,476 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,477 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3be527e2e29ec8ca9ea716b0c125138e, disabling compactions & flushes 2023-02-07 15:02:56,478 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:56,478 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:56,478 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. after waiting 0 ms 2023-02-07 15:02:56,478 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:56,478 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:56,478 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3be527e2e29ec8ca9ea716b0c125138e: Waiting for close lock at 1675782176477Disabling compacts and flushes for region at 1675782176477Disabling writes for close at 1675782176478 (+1 ms)Writing region close event to WAL at 1675782176478Closed at 1675782176478 2023-02-07 15:02:56,479 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9bf100dd186f8da978b872e75ccd5feb, NAME => 'testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,494 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,495 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,495 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9ef9bad482199871438184433fc8a468, disabling compactions & flushes 2023-02-07 15:02:56,495 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8732006a08753896dec326564ce25506, disabling compactions & flushes 2023-02-07 15:02:56,495 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:56,495 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:56,495 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:56,495 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. after waiting 0 ms 2023-02-07 15:02:56,496 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:56,496 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:56,496 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8732006a08753896dec326564ce25506: Waiting for close lock at 1675782176495Disabling compacts and flushes for region at 1675782176495Disabling writes for close at 1675782176496 (+1 ms)Writing region close event to WAL at 1675782176496Closed at 1675782176496 2023-02-07 15:02:56,495 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:56,496 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. after waiting 0 ms 2023-02-07 15:02:56,496 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 103665a1d009bf2ff6f6ad114e814ada, NAME => 'testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,496 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:56,496 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:56,497 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9ef9bad482199871438184433fc8a468: Waiting for close lock at 1675782176495Disabling compacts and flushes for region at 1675782176495Disabling writes for close at 1675782176496 (+1 ms)Writing region close event to WAL at 1675782176496Closed at 1675782176496 2023-02-07 15:02:56,497 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7252866e1cfc41cd1e12c0dfa4853f1e, NAME => 'testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,506 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,507 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9bf100dd186f8da978b872e75ccd5feb, disabling compactions & flushes 2023-02-07 15:02:56,507 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:56,507 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:56,507 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. after waiting 0 ms 2023-02-07 15:02:56,507 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:56,507 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:56,507 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9bf100dd186f8da978b872e75ccd5feb: Waiting for close lock at 1675782176507Disabling compacts and flushes for region at 1675782176507Disabling writes for close at 1675782176507Writing region close event to WAL at 1675782176507Closed at 1675782176507 2023-02-07 15:02:56,508 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 55855ecac7fbb082f88e04320f966648, NAME => 'testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp 2023-02-07 15:02:56,524 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,525 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 103665a1d009bf2ff6f6ad114e814ada, disabling compactions & flushes 2023-02-07 15:02:56,525 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:56,525 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:56,525 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. after waiting 0 ms 2023-02-07 15:02:56,525 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:56,525 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:56,525 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 103665a1d009bf2ff6f6ad114e814ada: Waiting for close lock at 1675782176525Disabling compacts and flushes for region at 1675782176525Disabling writes for close at 1675782176525Writing region close event to WAL at 1675782176525Closed at 1675782176525 2023-02-07 15:02:56,528 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,528 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7252866e1cfc41cd1e12c0dfa4853f1e, disabling compactions & flushes 2023-02-07 15:02:56,529 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:56,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:56,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. after waiting 0 ms 2023-02-07 15:02:56,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:56,529 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:56,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7252866e1cfc41cd1e12c0dfa4853f1e: Waiting for close lock at 1675782176528Disabling compacts and flushes for region at 1675782176528Disabling writes for close at 1675782176529 (+1 ms)Writing region close event to WAL at 1675782176529Closed at 1675782176529 2023-02-07 15:02:56,534 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 55855ecac7fbb082f88e04320f966648, disabling compactions & flushes 2023-02-07 15:02:56,535 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:56,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:56,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. after waiting 0 ms 2023-02-07 15:02:56,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:56,535 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:56,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 55855ecac7fbb082f88e04320f966648: Waiting for close lock at 1675782176535Disabling compacts and flushes for region at 1675782176535Disabling writes for close at 1675782176535Writing region close event to WAL at 1675782176535Closed at 1675782176535 2023-02-07 15:02:56,540 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:02:56,541 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675782176263.8732006a08753896dec326564ce25506.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675782176263.9ef9bad482199871438184433fc8a468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,543 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782176541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782176541"}]},"ts":"1675782176541"} 2023-02-07 15:02:56,591 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 15:02:56,592 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:02:56,593 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782176593"}]},"ts":"1675782176593"} 2023-02-07 15:02:56,595 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 15:02:56,600 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:02:56,614 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:02:56,614 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:02:56,614 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:02:56,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e146a9e07ae15a7e4bc579f6ea4489d6, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9f98b7b6c1c5a5a713d1b5bd16fc712f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed09922affb2fb864cd044e82f5a882, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3be527e2e29ec8ca9ea716b0c125138e, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8732006a08753896dec326564ce25506, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ef9bad482199871438184433fc8a468, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9bf100dd186f8da978b872e75ccd5feb, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=103665a1d009bf2ff6f6ad114e814ada, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7252866e1cfc41cd1e12c0dfa4853f1e, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=55855ecac7fbb082f88e04320f966648, ASSIGN}] 2023-02-07 15:02:56,619 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9f98b7b6c1c5a5a713d1b5bd16fc712f, ASSIGN 2023-02-07 15:02:56,619 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e146a9e07ae15a7e4bc579f6ea4489d6, ASSIGN 2023-02-07 15:02:56,620 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed09922affb2fb864cd044e82f5a882, ASSIGN 2023-02-07 15:02:56,620 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3be527e2e29ec8ca9ea716b0c125138e, ASSIGN 2023-02-07 15:02:56,621 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9f98b7b6c1c5a5a713d1b5bd16fc712f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36137,1675782173383; forceNewPlan=false, retain=false 2023-02-07 15:02:56,622 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e146a9e07ae15a7e4bc579f6ea4489d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38637,1675782173332; forceNewPlan=false, retain=false 2023-02-07 15:02:56,622 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4ed09922affb2fb864cd044e82f5a882, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38637,1675782173332; forceNewPlan=false, retain=false 2023-02-07 15:02:56,622 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3be527e2e29ec8ca9ea716b0c125138e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36137,1675782173383; forceNewPlan=false, retain=false 2023-02-07 15:02:56,623 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=55855ecac7fbb082f88e04320f966648, ASSIGN 2023-02-07 15:02:56,623 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7252866e1cfc41cd1e12c0dfa4853f1e, ASSIGN 2023-02-07 15:02:56,623 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=103665a1d009bf2ff6f6ad114e814ada, ASSIGN 2023-02-07 15:02:56,624 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9bf100dd186f8da978b872e75ccd5feb, ASSIGN 2023-02-07 15:02:56,624 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ef9bad482199871438184433fc8a468, ASSIGN 2023-02-07 15:02:56,625 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=55855ecac7fbb082f88e04320f966648, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36137,1675782173383; forceNewPlan=false, retain=false 2023-02-07 15:02:56,625 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:56,625 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:56,625 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7252866e1cfc41cd1e12c0dfa4853f1e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38637,1675782173332; forceNewPlan=false, retain=false 2023-02-07 15:02:56,625 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=103665a1d009bf2ff6f6ad114e814ada, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36137,1675782173383; forceNewPlan=false, retain=false 2023-02-07 15:02:56,625 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9bf100dd186f8da978b872e75ccd5feb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38637,1675782173332; forceNewPlan=false, retain=false 2023-02-07 15:02:56,626 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9ef9bad482199871438184433fc8a468, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36137,1675782173383; forceNewPlan=false, retain=false 2023-02-07 15:02:56,626 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8732006a08753896dec326564ce25506, ASSIGN 2023-02-07 15:02:56,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:02:56,628 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8732006a08753896dec326564ce25506, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38637,1675782173332; forceNewPlan=false, retain=false 2023-02-07 15:02:56,772 INFO [jenkins-hbase4:34131] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 15:02:56,775 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7252866e1cfc41cd1e12c0dfa4853f1e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:56,775 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e146a9e07ae15a7e4bc579f6ea4489d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:56,775 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8732006a08753896dec326564ce25506, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:56,775 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9bf100dd186f8da978b872e75ccd5feb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:56,775 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782176775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176775"}]},"ts":"1675782176775"} 2023-02-07 15:02:56,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4ed09922affb2fb864cd044e82f5a882, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:56,776 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675782176263.8732006a08753896dec326564ce25506.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176775"}]},"ts":"1675782176775"} 2023-02-07 15:02:56,776 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176775"}]},"ts":"1675782176775"} 2023-02-07 15:02:56,775 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176775"}]},"ts":"1675782176775"} 2023-02-07 15:02:56,776 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176775"}]},"ts":"1675782176775"} 2023-02-07 15:02:56,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure e146a9e07ae15a7e4bc579f6ea4489d6, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:02:56,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure 8732006a08753896dec326564ce25506, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:02:56,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 9bf100dd186f8da978b872e75ccd5feb, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:02:56,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 7252866e1cfc41cd1e12c0dfa4853f1e, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:02:56,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 4ed09922affb2fb864cd044e82f5a882, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:02:56,786 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=103665a1d009bf2ff6f6ad114e814ada, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:56,786 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176786"}]},"ts":"1675782176786"} 2023-02-07 15:02:56,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 103665a1d009bf2ff6f6ad114e814ada, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:02:56,789 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9f98b7b6c1c5a5a713d1b5bd16fc712f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:56,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176789"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176789"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176789"}]},"ts":"1675782176789"} 2023-02-07 15:02:56,791 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9ef9bad482199871438184433fc8a468, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:56,791 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675782176263.9ef9bad482199871438184433fc8a468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176791"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176791"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176791"}]},"ts":"1675782176791"} 2023-02-07 15:02:56,792 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=55855ecac7fbb082f88e04320f966648, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:56,793 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782176792"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176792"}]},"ts":"1675782176792"} 2023-02-07 15:02:56,796 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3be527e2e29ec8ca9ea716b0c125138e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:56,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 9f98b7b6c1c5a5a713d1b5bd16fc712f, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:02:56,796 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176796"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782176796"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782176796"}]},"ts":"1675782176796"} 2023-02-07 15:02:56,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=16, state=RUNNABLE; OpenRegionProcedure 9ef9bad482199871438184433fc8a468, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:02:56,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure 55855ecac7fbb082f88e04320f966648, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:02:56,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 3be527e2e29ec8ca9ea716b0c125138e, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:02:56,928 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:56,928 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:56,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:02:56,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:56,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ed09922affb2fb864cd044e82f5a882, NAME => 'testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 15:02:56,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,941 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,943 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1 2023-02-07 15:02:56,944 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1 2023-02-07 15:02:56,944 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed09922affb2fb864cd044e82f5a882 columnFamilyName f1 2023-02-07 15:02:56,945 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(310): Store=4ed09922affb2fb864cd044e82f5a882/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:56,945 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,947 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2 2023-02-07 15:02:56,948 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2 2023-02-07 15:02:56,948 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed09922affb2fb864cd044e82f5a882 columnFamilyName f2 2023-02-07 15:02:56,949 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(310): Store=4ed09922affb2fb864cd044e82f5a882/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:56,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:56,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 103665a1d009bf2ff6f6ad114e814ada, NAME => 'testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 15:02:56,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,957 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:56,959 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1 2023-02-07 15:02:56,959 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1 2023-02-07 15:02:56,960 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 103665a1d009bf2ff6f6ad114e814ada columnFamilyName f1 2023-02-07 15:02:56,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:02:56,960 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(310): Store=103665a1d009bf2ff6f6ad114e814ada/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:56,961 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,963 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2 2023-02-07 15:02:56,963 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2 2023-02-07 15:02:56,964 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 103665a1d009bf2ff6f6ad114e814ada columnFamilyName f2 2023-02-07 15:02:56,965 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(310): Store=103665a1d009bf2ff6f6ad114e814ada/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:56,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4ed09922affb2fb864cd044e82f5a882; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72409695, jitterRate=0.07898853719234467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4ed09922affb2fb864cd044e82f5a882: Running coprocessor pre-open hook at 1675782176940Writing region info on filesystem at 1675782176940Initializing all the Stores at 1675782176941 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782176941Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782176941Cleaning up temporary data from old regions at 1675782176956 (+15 ms)Cleaning up detritus from prior splits at 1675782176957 (+1 ms)Running coprocessor post-open hooks at 1675782176968 (+11 ms)Region opened successfully at 1675782176968 2023-02-07 15:02:56,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882., pid=25, masterSystemTime=1675782176932 2023-02-07 15:02:56,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:56,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:56,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:56,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9bf100dd186f8da978b872e75ccd5feb, NAME => 'testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 15:02:56,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:56,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:56,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:56,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:56,974 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4ed09922affb2fb864cd044e82f5a882, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:56,975 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782176974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782176974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782176974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782176974"}]},"ts":"1675782176974"} 2023-02-07 15:02:56,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:02:56,982 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:56,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-07 15:02:56,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 4ed09922affb2fb864cd044e82f5a882, server=jenkins-hbase4.apache.org,38637,1675782173332 in 195 msec 2023-02-07 15:02:56,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:56,987 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1 2023-02-07 15:02:56,987 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1 2023-02-07 15:02:56,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 103665a1d009bf2ff6f6ad114e814ada; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71200442, jitterRate=0.060969263315200806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:56,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4ed09922affb2fb864cd044e82f5a882, ASSIGN in 370 msec 2023-02-07 15:02:56,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 103665a1d009bf2ff6f6ad114e814ada: Running coprocessor pre-open hook at 1675782176955Writing region info on filesystem at 1675782176955Initializing all the Stores at 1675782176957 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782176957Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782176957Cleaning up temporary data from old regions at 1675782176969 (+12 ms)Cleaning up detritus from prior splits at 1675782176970 (+1 ms)Running coprocessor post-open hooks at 1675782176988 (+18 ms)Region opened successfully at 1675782176988 2023-02-07 15:02:56,989 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bf100dd186f8da978b872e75ccd5feb columnFamilyName f1 2023-02-07 15:02:56,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada., pid=26, masterSystemTime=1675782176946 2023-02-07 15:02:56,990 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(310): Store=9bf100dd186f8da978b872e75ccd5feb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:56,992 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:56,998 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2 2023-02-07 15:02:56,998 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2 2023-02-07 15:02:56,998 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bf100dd186f8da978b872e75ccd5feb columnFamilyName f2 2023-02-07 15:02:56,999 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(310): Store=9bf100dd186f8da978b872e75ccd5feb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:57,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:57,003 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=103665a1d009bf2ff6f6ad114e814ada, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:57,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:57,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:57,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3be527e2e29ec8ca9ea716b0c125138e, NAME => 'testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 15:02:57,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:57,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:57,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,012 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782177003"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177003"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177003"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177003"}]},"ts":"1675782177003"} 2023-02-07 15:02:57,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-07 15:02:57,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 103665a1d009bf2ff6f6ad114e814ada, server=jenkins-hbase4.apache.org,36137,1675782173383 in 227 msec 2023-02-07 15:02:57,021 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:02:57,024 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1 2023-02-07 15:02:57,024 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1 2023-02-07 15:02:57,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=103665a1d009bf2ff6f6ad114e814ada, ASSIGN in 405 msec 2023-02-07 15:02:57,025 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be527e2e29ec8ca9ea716b0c125138e columnFamilyName f1 2023-02-07 15:02:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,026 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(310): Store=3be527e2e29ec8ca9ea716b0c125138e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,027 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9bf100dd186f8da978b872e75ccd5feb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65096692, jitterRate=-0.029983699321746826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9bf100dd186f8da978b872e75ccd5feb: Running coprocessor pre-open hook at 1675782176975Writing region info on filesystem at 1675782176975Initializing all the Stores at 1675782176976 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782176976Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782176980 (+4 ms)Cleaning up temporary data from old regions at 1675782177016 (+36 ms)Cleaning up detritus from prior splits at 1675782177017 (+1 ms)Running coprocessor post-open hooks at 1675782177027 (+10 ms)Region opened successfully at 1675782177027 2023-02-07 15:02:57,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb., pid=23, masterSystemTime=1675782176932 2023-02-07 15:02:57,030 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2 2023-02-07 15:02:57,031 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2 2023-02-07 15:02:57,032 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be527e2e29ec8ca9ea716b0c125138e columnFamilyName f2 2023-02-07 15:02:57,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:57,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:57,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:57,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9bf100dd186f8da978b872e75ccd5feb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:57,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8732006a08753896dec326564ce25506, NAME => 'testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 15:02:57,034 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782177033"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177033"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177033"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177033"}]},"ts":"1675782177033"} 2023-02-07 15:02:57,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8732006a08753896dec326564ce25506 2023-02-07 15:02:57,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:57,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8732006a08753896dec326564ce25506 2023-02-07 15:02:57,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8732006a08753896dec326564ce25506 2023-02-07 15:02:57,035 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(310): Store=3be527e2e29ec8ca9ea716b0c125138e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,038 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8732006a08753896dec326564ce25506 2023-02-07 15:02:57,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,042 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1 2023-02-07 15:02:57,042 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1 2023-02-07 15:02:57,043 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8732006a08753896dec326564ce25506 columnFamilyName f1 2023-02-07 15:02:57,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-07 15:02:57,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 9bf100dd186f8da978b872e75ccd5feb, server=jenkins-hbase4.apache.org,38637,1675782173332 in 254 msec 2023-02-07 15:02:57,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,045 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(310): Store=8732006a08753896dec326564ce25506/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,046 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8732006a08753896dec326564ce25506 2023-02-07 15:02:57,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9bf100dd186f8da978b872e75ccd5feb, ASSIGN in 429 msec 2023-02-07 15:02:57,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:02:57,048 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2 2023-02-07 15:02:57,048 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2 2023-02-07 15:02:57,049 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8732006a08753896dec326564ce25506 columnFamilyName f2 2023-02-07 15:02:57,050 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(310): Store=8732006a08753896dec326564ce25506/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506 2023-02-07 15:02:57,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506 2023-02-07 15:02:57,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3be527e2e29ec8ca9ea716b0c125138e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64875406, jitterRate=-0.0332811176776886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3be527e2e29ec8ca9ea716b0c125138e: Running coprocessor pre-open hook at 1675782177005Writing region info on filesystem at 1675782177005Initializing all the Stores at 1675782177013 (+8 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177014 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177020 (+6 ms)Cleaning up temporary data from old regions at 1675782177040 (+20 ms)Cleaning up detritus from prior splits at 1675782177042 (+2 ms)Running coprocessor post-open hooks at 1675782177054 (+12 ms)Region opened successfully at 1675782177054 2023-02-07 15:02:57,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e., pid=30, masterSystemTime=1675782176946 2023-02-07 15:02:57,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:57,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:57,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:57,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9ef9bad482199871438184433fc8a468, NAME => 'testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 15:02:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:57,059 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3be527e2e29ec8ca9ea716b0c125138e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8732006a08753896dec326564ce25506 2023-02-07 15:02:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,059 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782177059"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177059"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177059"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177059"}]},"ts":"1675782177059"} 2023-02-07 15:02:57,061 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,063 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1 2023-02-07 15:02:57,063 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1 2023-02-07 15:02:57,063 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ef9bad482199871438184433fc8a468 columnFamilyName f1 2023-02-07 15:02:57,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8732006a08753896dec326564ce25506; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61449322, jitterRate=-0.08433374762535095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,064 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(310): Store=9ef9bad482199871438184433fc8a468/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8732006a08753896dec326564ce25506: Running coprocessor pre-open hook at 1675782177034Writing region info on filesystem at 1675782177034Initializing all the Stores at 1675782177036 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177036Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177037 (+1 ms)Cleaning up temporary data from old regions at 1675782177055 (+18 ms)Cleaning up detritus from prior splits at 1675782177055Running coprocessor post-open hooks at 1675782177064 (+9 ms)Region opened successfully at 1675782177064 2023-02-07 15:02:57,064 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506., pid=22, masterSystemTime=1675782176932 2023-02-07 15:02:57,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-07 15:02:57,067 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2 2023-02-07 15:02:57,067 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2 2023-02-07 15:02:57,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 3be527e2e29ec8ca9ea716b0c125138e, server=jenkins-hbase4.apache.org,36137,1675782173383 in 258 msec 2023-02-07 15:02:57,067 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ef9bad482199871438184433fc8a468 columnFamilyName f2 2023-02-07 15:02:57,068 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(310): Store=9ef9bad482199871438184433fc8a468/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:57,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:57,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:57,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e146a9e07ae15a7e4bc579f6ea4489d6, NAME => 'testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 15:02:57,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:57,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3be527e2e29ec8ca9ea716b0c125138e, ASSIGN in 452 msec 2023-02-07 15:02:57,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,070 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8732006a08753896dec326564ce25506, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:57,070 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675782176263.8732006a08753896dec326564ce25506.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782177070"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177070"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177070"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177070"}]},"ts":"1675782177070"} 2023-02-07 15:02:57,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,072 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,074 DEBUG [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f1 2023-02-07 15:02:57,074 DEBUG [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f1 2023-02-07 15:02:57,075 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e146a9e07ae15a7e4bc579f6ea4489d6 columnFamilyName f1 2023-02-07 15:02:57,076 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(310): Store=e146a9e07ae15a7e4bc579f6ea4489d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,076 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,078 DEBUG [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f2 2023-02-07 15:02:57,078 DEBUG [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f2 2023-02-07 15:02:57,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-07 15:02:57,079 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e146a9e07ae15a7e4bc579f6ea4489d6 columnFamilyName f2 2023-02-07 15:02:57,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure 8732006a08753896dec326564ce25506, server=jenkins-hbase4.apache.org,38637,1675782173332 in 294 msec 2023-02-07 15:02:57,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9ef9bad482199871438184433fc8a468 2023-02-07 15:02:57,079 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(310): Store=e146a9e07ae15a7e4bc579f6ea4489d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8732006a08753896dec326564ce25506, ASSIGN in 464 msec 2023-02-07 15:02:57,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9ef9bad482199871438184433fc8a468; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67301743, jitterRate=0.002874121069908142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9ef9bad482199871438184433fc8a468: Running coprocessor pre-open hook at 1675782177059Writing region info on filesystem at 1675782177059Initializing all the Stores at 1675782177060 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177060Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177060Cleaning up temporary data from old regions at 1675782177073 (+13 ms)Cleaning up detritus from prior splits at 1675782177075 (+2 ms)Running coprocessor post-open hooks at 1675782177084 (+9 ms)Region opened successfully at 1675782177084 2023-02-07 15:02:57,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468., pid=28, masterSystemTime=1675782176946 2023-02-07 15:02:57,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:57,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:57,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:57,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 55855ecac7fbb082f88e04320f966648, NAME => 'testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 15:02:57,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,089 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9ef9bad482199871438184433fc8a468, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:57,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:57,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,089 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675782176263.9ef9bad482199871438184433fc8a468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782177089"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177089"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177089"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177089"}]},"ts":"1675782177089"} 2023-02-07 15:02:57,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,091 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:02:57,094 DEBUG [StoreOpener-55855ecac7fbb082f88e04320f966648-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f1 2023-02-07 15:02:57,094 DEBUG [StoreOpener-55855ecac7fbb082f88e04320f966648-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f1 2023-02-07 15:02:57,094 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55855ecac7fbb082f88e04320f966648 columnFamilyName f1 2023-02-07 15:02:57,095 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(310): Store=55855ecac7fbb082f88e04320f966648/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,095 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e146a9e07ae15a7e4bc579f6ea4489d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62203829, jitterRate=-0.07309071719646454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e146a9e07ae15a7e4bc579f6ea4489d6: Running coprocessor pre-open hook at 1675782177070Writing region info on filesystem at 1675782177070Initializing all the Stores at 1675782177071 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177071Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177072 (+1 ms)Cleaning up temporary data from old regions at 1675782177085 (+13 ms)Cleaning up detritus from prior splits at 1675782177089 (+4 ms)Running coprocessor post-open hooks at 1675782177098 (+9 ms)Region opened successfully at 1675782177098 2023-02-07 15:02:57,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6., pid=21, masterSystemTime=1675782176932 2023-02-07 15:02:57,099 DEBUG [StoreOpener-55855ecac7fbb082f88e04320f966648-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f2 2023-02-07 15:02:57,100 DEBUG [StoreOpener-55855ecac7fbb082f88e04320f966648-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f2 2023-02-07 15:02:57,100 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55855ecac7fbb082f88e04320f966648 columnFamilyName f2 2023-02-07 15:02:57,101 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(310): Store=55855ecac7fbb082f88e04320f966648/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:57,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:57,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:57,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7252866e1cfc41cd1e12c0dfa4853f1e, NAME => 'testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 15:02:57,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,110 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e146a9e07ae15a7e4bc579f6ea4489d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:57,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:57,110 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782177110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177110"}]},"ts":"1675782177110"} 2023-02-07 15:02:57,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=16 2023-02-07 15:02:57,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=16, state=SUCCESS; OpenRegionProcedure 9ef9bad482199871438184433fc8a468, server=jenkins-hbase4.apache.org,36137,1675782173383 in 311 msec 2023-02-07 15:02:57,115 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ef9bad482199871438184433fc8a468, ASSIGN in 498 msec 2023-02-07 15:02:57,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-07 15:02:57,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure e146a9e07ae15a7e4bc579f6ea4489d6, server=jenkins-hbase4.apache.org,38637,1675782173332 in 335 msec 2023-02-07 15:02:57,119 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1 2023-02-07 15:02:57,119 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1 2023-02-07 15:02:57,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 55855ecac7fbb082f88e04320f966648 2023-02-07 15:02:57,119 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7252866e1cfc41cd1e12c0dfa4853f1e columnFamilyName f1 2023-02-07 15:02:57,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e146a9e07ae15a7e4bc579f6ea4489d6, ASSIGN in 504 msec 2023-02-07 15:02:57,120 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(310): Store=7252866e1cfc41cd1e12c0dfa4853f1e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,120 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,122 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2 2023-02-07 15:02:57,123 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2 2023-02-07 15:02:57,123 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7252866e1cfc41cd1e12c0dfa4853f1e columnFamilyName f2 2023-02-07 15:02:57,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 55855ecac7fbb082f88e04320f966648; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73679640, jitterRate=0.09791219234466553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 55855ecac7fbb082f88e04320f966648: Running coprocessor pre-open hook at 1675782177090Writing region info on filesystem at 1675782177090Initializing all the Stores at 1675782177091 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177091Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177091Cleaning up temporary data from old regions at 1675782177114 (+23 ms)Cleaning up detritus from prior splits at 1675782177115 (+1 ms)Running coprocessor post-open hooks at 1675782177124 (+9 ms)Region opened successfully at 1675782177124 2023-02-07 15:02:57,124 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(310): Store=7252866e1cfc41cd1e12c0dfa4853f1e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648., pid=29, masterSystemTime=1675782176946 2023-02-07 15:02:57,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:57,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:57,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:57,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9f98b7b6c1c5a5a713d1b5bd16fc712f, NAME => 'testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 15:02:57,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:02:57,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=55855ecac7fbb082f88e04320f966648, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:57,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782177129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177129"}]},"ts":"1675782177129"} 2023-02-07 15:02:57,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:02:57,132 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,135 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1 2023-02-07 15:02:57,135 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1 2023-02-07 15:02:57,135 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f98b7b6c1c5a5a713d1b5bd16fc712f columnFamilyName f1 2023-02-07 15:02:57,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,136 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(310): Store=9f98b7b6c1c5a5a713d1b5bd16fc712f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-07 15:02:57,137 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure 55855ecac7fbb082f88e04320f966648, server=jenkins-hbase4.apache.org,36137,1675782173383 in 333 msec 2023-02-07 15:02:57,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7252866e1cfc41cd1e12c0dfa4853f1e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68725678, jitterRate=0.024092406034469604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7252866e1cfc41cd1e12c0dfa4853f1e: Running coprocessor pre-open hook at 1675782177111Writing region info on filesystem at 1675782177111Initializing all the Stores at 1675782177114 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177114Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177115 (+1 ms)Cleaning up temporary data from old regions at 1675782177127 (+12 ms)Cleaning up detritus from prior splits at 1675782177128 (+1 ms)Running coprocessor post-open hooks at 1675782177137 (+9 ms)Region opened successfully at 1675782177137 2023-02-07 15:02:57,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e., pid=24, masterSystemTime=1675782176932 2023-02-07 15:02:57,139 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2 2023-02-07 15:02:57,139 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2 2023-02-07 15:02:57,140 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f98b7b6c1c5a5a713d1b5bd16fc712f columnFamilyName f2 2023-02-07 15:02:57,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=55855ecac7fbb082f88e04320f966648, ASSIGN in 522 msec 2023-02-07 15:02:57,141 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(310): Store=9f98b7b6c1c5a5a713d1b5bd16fc712f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:02:57,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:57,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:57,142 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7252866e1cfc41cd1e12c0dfa4853f1e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:57,143 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782177142"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177142"}]},"ts":"1675782177142"} 2023-02-07 15:02:57,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:02:57,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-07 15:02:57,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:02:57,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 7252866e1cfc41cd1e12c0dfa4853f1e, server=jenkins-hbase4.apache.org,38637,1675782173332 in 361 msec 2023-02-07 15:02:57,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7252866e1cfc41cd1e12c0dfa4853f1e, ASSIGN in 533 msec 2023-02-07 15:02:57,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:02:57,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9f98b7b6c1c5a5a713d1b5bd16fc712f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75454805, jitterRate=0.1243642121553421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:02:57,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: Running coprocessor pre-open hook at 1675782177130Writing region info on filesystem at 1675782177130Initializing all the Stores at 1675782177132 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177132Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782177132Cleaning up temporary data from old regions at 1675782177145 (+13 ms)Cleaning up detritus from prior splits at 1675782177145Running coprocessor post-open hooks at 1675782177152 (+7 ms)Region opened successfully at 1675782177152 2023-02-07 15:02:57,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f., pid=27, masterSystemTime=1675782176946 2023-02-07 15:02:57,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:57,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:57,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9f98b7b6c1c5a5a713d1b5bd16fc712f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:57,156 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782177156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782177156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782177156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782177156"}]},"ts":"1675782177156"} 2023-02-07 15:02:57,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-07 15:02:57,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 9f98b7b6c1c5a5a713d1b5bd16fc712f, server=jenkins-hbase4.apache.org,36137,1675782173383 in 362 msec 2023-02-07 15:02:57,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-07 15:02:57,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9f98b7b6c1c5a5a713d1b5bd16fc712f, ASSIGN in 547 msec 2023-02-07 15:02:57,165 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:02:57,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782177166"}]},"ts":"1675782177166"} 2023-02-07 15:02:57,168 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 15:02:57,171 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:02:57,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 902 msec 2023-02-07 15:02:57,430 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:57,430 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:02:57,433 INFO [Listener at localhost/42259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 15:02:57,433 DEBUG [Listener at localhost/42259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 15:02:57,435 INFO [Listener at localhost/42259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:02:57,446 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 15:02:57,447 INFO [Listener at localhost/42259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:02:57,447 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 15:02:57,447 INFO [Listener at localhost/42259] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 15:02:57,621 DEBUG [hconnection-0x4d22e124-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:02:57,670 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38056, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:02:57,710 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36137] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:57,713 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38637] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:58,065 INFO [Listener at localhost/42259] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 15:02:58,069 INFO [Listener at localhost/42259] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 15:02:58,078 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:58,079 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:58,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:02:58,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675782178082 (current time:1675782178082). 2023-02-07 15:02:58,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 15:02:58,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] zookeeper.ReadOnlyZKClient(139): Connect 0x382af44c to 127.0.0.1:50408 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:02:58,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@130ca446, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:02:58,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:02:58,098 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:02:58,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x382af44c to 127.0.0.1:50408 2023-02-07 15:02:58,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:02:58,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 15:02:58,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:02:58,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:02:58,127 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:02:58,128 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675782778128 2023-02-07 15:02:58,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:02:58,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 15:02:58,134 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:02:58,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:02:58,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 17 msec 2023-02-07 15:02:58,137 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:02:58,137 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 15:02:58,137 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 15:02:58,138 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675782778138 2023-02-07 15:02:58,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-07 15:02:58,184 INFO [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-07 15:02:58,184 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:02:58,185 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-07 15:02:58,185 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 15:02:58,185 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:58,185 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 15:02:58,187 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:02:58,187 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:02:58,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:02:58,187 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:02:58,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:02:58,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:02:58,188 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,188 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 15:02:58,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 15:02:58,188 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,188 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:02:58,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:58,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:58,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-07 15:02:58,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 15:02:58,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 15:02:58,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-07 15:02:58,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 15:02:58,192 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 15:02:58,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-07 15:02:58,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-07 15:02:58,194 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-07 15:02:58,194 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:02:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 15:02:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-07 15:02:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-07 15:02:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36137,1675782173383' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-07 15:02:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:02:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 15:02:58,196 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-07 15:02:58,196 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38637,1675782173332' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-07 15:02:58,197 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,197 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:02:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:02:58,198 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,198 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,198 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:02:58,198 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:02:58,198 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,198 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:02:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:02:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:02:58,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36137,1675782173383' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-07 15:02:58,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a98c6b[Count = 1] remaining members to acquire global barrier 2023-02-07 15:02:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:02:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:02:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:02:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:02:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:02:58,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38637,1675782173332' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-07 15:02:58,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a98c6b[Count = 0] remaining members to acquire global barrier 2023-02-07 15:02:58,206 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 15:02:58,206 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,209 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,209 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 15:02:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 15:02:58,209 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,210 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,210 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. started... 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:58,211 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 15:02:58,211 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:58,212 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. started... 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. started... 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. started... 2023-02-07 15:02:58,212 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 15:02:58,212 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:58,211 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. started... 2023-02-07 15:02:58,212 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. started... 2023-02-07 15:02:58,212 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:02:58,214 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3be527e2e29ec8ca9ea716b0c125138e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:02:58,215 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9ef9bad482199871438184433fc8a468 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:02:58,215 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 8732006a08753896dec326564ce25506 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:02:58,214 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 4ed09922affb2fb864cd044e82f5a882 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:02:58,218 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 55855ecac7fbb082f88e04320f966648: 2023-02-07 15:02:58,219 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,224 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7252866e1cfc41cd1e12c0dfa4853f1e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 15:02:58,226 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,234 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:02:58,235 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:02:58,238 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:02:58,238 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:58,238 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:58,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:02:58,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:02:58,244 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 15:02:58,260 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. completed. 2023-02-07 15:02:58,260 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:58,261 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:58,261 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 15:02:58,261 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. started... 2023-02-07 15:02:58,276 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 9f98b7b6c1c5a5a713d1b5bd16fc712f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 15:02:58,397 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f1/f14fd8e5e2bc4e4dbbf58132c4f93892 2023-02-07 15:02:58,420 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f1/10098188e90c47fd98e3038a007e832c 2023-02-07 15:02:58,428 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f1/74f0b480eafa4b95a8a7036c803ca6c2 2023-02-07 15:02:58,445 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:02:58,445 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:58,445 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:58,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:02:58,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:02:58,448 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 15:02:58,560 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f2/c55110b195a249f58f9e12d8ce28a2ef 2023-02-07 15:02:58,564 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f2/6c01a83433794017b502f67b5a46ac5a 2023-02-07 15:02:58,566 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f2/b846ec8c2b4a43b18a5cb95abf502505 2023-02-07 15:02:58,574 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f1/74f0b480eafa4b95a8a7036c803ca6c2 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/74f0b480eafa4b95a8a7036c803ca6c2 2023-02-07 15:02:58,575 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f1/f14fd8e5e2bc4e4dbbf58132c4f93892 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/f14fd8e5e2bc4e4dbbf58132c4f93892 2023-02-07 15:02:58,581 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f1/10098188e90c47fd98e3038a007e832c as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/10098188e90c47fd98e3038a007e832c 2023-02-07 15:02:58,588 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/74f0b480eafa4b95a8a7036c803ca6c2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,588 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/f14fd8e5e2bc4e4dbbf58132c4f93892, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:02:58,591 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f2/c55110b195a249f58f9e12d8ce28a2ef as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/c55110b195a249f58f9e12d8ce28a2ef 2023-02-07 15:02:58,591 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f2/6c01a83433794017b502f67b5a46ac5a as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/6c01a83433794017b502f67b5a46ac5a 2023-02-07 15:02:58,597 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/10098188e90c47fd98e3038a007e832c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:02:58,598 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f2/b846ec8c2b4a43b18a5cb95abf502505 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/b846ec8c2b4a43b18a5cb95abf502505 2023-02-07 15:02:58,604 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/6c01a83433794017b502f67b5a46ac5a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:02:58,606 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/c55110b195a249f58f9e12d8ce28a2ef, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,608 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7252866e1cfc41cd1e12c0dfa4853f1e in 384ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,608 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/b846ec8c2b4a43b18a5cb95abf502505, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:02:58,609 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4ed09922affb2fb864cd044e82f5a882 in 395ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,610 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 9f98b7b6c1c5a5a713d1b5bd16fc712f in 334ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,610 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 15:02:58,610 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 15:02:58,610 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4ed09922affb2fb864cd044e82f5a882: 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7252866e1cfc41cd1e12c0dfa4853f1e: 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,614 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,615 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,615 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/f14fd8e5e2bc4e4dbbf58132c4f93892] hfiles 2023-02-07 15:02:58,615 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/10098188e90c47fd98e3038a007e832c] hfiles 2023-02-07 15:02:58,615 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/f14fd8e5e2bc4e4dbbf58132c4f93892 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,615 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/74f0b480eafa4b95a8a7036c803ca6c2] hfiles 2023-02-07 15:02:58,615 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/10098188e90c47fd98e3038a007e832c for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,615 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/74f0b480eafa4b95a8a7036c803ca6c2 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,620 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/6c01a83433794017b502f67b5a46ac5a] hfiles 2023-02-07 15:02:58,620 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/6c01a83433794017b502f67b5a46ac5a for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,620 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/b846ec8c2b4a43b18a5cb95abf502505] hfiles 2023-02-07 15:02:58,620 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/c55110b195a249f58f9e12d8ce28a2ef] hfiles 2023-02-07 15:02:58,620 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/b846ec8c2b4a43b18a5cb95abf502505 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,620 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/c55110b195a249f58f9e12d8ce28a2ef for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,665 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. completed. 2023-02-07 15:02:58,665 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:58,666 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:58,666 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. started... 2023-02-07 15:02:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 15:02:58,667 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 103665a1d009bf2ff6f6ad114e814ada 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:02:58,667 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. completed. 2023-02-07 15:02:58,668 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:58,668 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. completed. 2023-02-07 15:02:58,668 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 15:02:58,668 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:58,668 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:58,668 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:58,668 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. started... 2023-02-07 15:02:58,668 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. started... 2023-02-07 15:02:58,669 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9bf100dd186f8da978b872e75ccd5feb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 15:02:58,670 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e146a9e07ae15a7e4bc579f6ea4489d6: 2023-02-07 15:02:58,670 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,670 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,671 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:02:58,671 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:02:58,696 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. completed. 2023-02-07 15:02:58,696 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:58,696 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 15:02:58,708 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f1/8eefbfd89e2146829bc01453499564e2 2023-02-07 15:02:58,710 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f1/c2ccea970e7f4e0f867d98b72a83f925 2023-02-07 15:02:58,737 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f2/b45d1d72847f44b69859f1e88856036d 2023-02-07 15:02:58,740 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f2/56a39ed907494a4b8304fe41a5c29ff4 2023-02-07 15:02:58,746 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f1/8eefbfd89e2146829bc01453499564e2 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/8eefbfd89e2146829bc01453499564e2 2023-02-07 15:02:58,748 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:02:58,749 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:58,749 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:58,749 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f1/c2ccea970e7f4e0f867d98b72a83f925 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/c2ccea970e7f4e0f867d98b72a83f925 2023-02-07 15:02:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:02:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:02:58,751 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 15:02:58,755 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/8eefbfd89e2146829bc01453499564e2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,756 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f2/b45d1d72847f44b69859f1e88856036d as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/b45d1d72847f44b69859f1e88856036d 2023-02-07 15:02:58,757 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/c2ccea970e7f4e0f867d98b72a83f925, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,758 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f2/56a39ed907494a4b8304fe41a5c29ff4 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/56a39ed907494a4b8304fe41a5c29ff4 2023-02-07 15:02:58,766 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/56a39ed907494a4b8304fe41a5c29ff4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,766 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/b45d1d72847f44b69859f1e88856036d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,767 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 103665a1d009bf2ff6f6ad114e814ada in 101ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 103665a1d009bf2ff6f6ad114e814ada: 2023-02-07 15:02:58,768 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9bf100dd186f8da978b872e75ccd5feb in 99ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9bf100dd186f8da978b872e75ccd5feb: 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/c2ccea970e7f4e0f867d98b72a83f925] hfiles 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/c2ccea970e7f4e0f867d98b72a83f925 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/56a39ed907494a4b8304fe41a5c29ff4] hfiles 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/8eefbfd89e2146829bc01453499564e2] hfiles 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/8eefbfd89e2146829bc01453499564e2 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/56a39ed907494a4b8304fe41a5c29ff4 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/b45d1d72847f44b69859f1e88856036d] hfiles 2023-02-07 15:02:58,768 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/b45d1d72847f44b69859f1e88856036d for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,788 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. completed. 2023-02-07 15:02:58,788 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:58,789 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 15:02:58,790 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. completed. 2023-02-07 15:02:58,790 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:58,790 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 15:02:58,820 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f1/783867fd2f62415bbfb8046049b472c6 2023-02-07 15:02:58,825 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f1/a646ddb125ec4b77a5aa3a5df0f31afa 2023-02-07 15:02:58,830 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f1/90b8fa76f0a742158fe53a01e5a7ba1c 2023-02-07 15:02:58,856 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f2/f5841fdca06d4a4f9a8587b87f44fb78 2023-02-07 15:02:58,864 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f2/04d9399ff8f042b9a2a8f89a76246950 2023-02-07 15:02:58,867 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f1/783867fd2f62415bbfb8046049b472c6 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/783867fd2f62415bbfb8046049b472c6 2023-02-07 15:02:58,868 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f2/501b192e51b245e0bba84c262600dc9a 2023-02-07 15:02:58,877 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f1/90b8fa76f0a742158fe53a01e5a7ba1c as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/90b8fa76f0a742158fe53a01e5a7ba1c 2023-02-07 15:02:58,884 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/783867fd2f62415bbfb8046049b472c6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,885 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/90b8fa76f0a742158fe53a01e5a7ba1c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,886 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f2/f5841fdca06d4a4f9a8587b87f44fb78 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/f5841fdca06d4a4f9a8587b87f44fb78 2023-02-07 15:02:58,887 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f1/a646ddb125ec4b77a5aa3a5df0f31afa as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/a646ddb125ec4b77a5aa3a5df0f31afa 2023-02-07 15:02:58,887 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f2/04d9399ff8f042b9a2a8f89a76246950 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/04d9399ff8f042b9a2a8f89a76246950 2023-02-07 15:02:58,895 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/f5841fdca06d4a4f9a8587b87f44fb78, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,896 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3be527e2e29ec8ca9ea716b0c125138e in 682ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,896 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3be527e2e29ec8ca9ea716b0c125138e: 2023-02-07 15:02:58,897 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,897 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,897 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/783867fd2f62415bbfb8046049b472c6] hfiles 2023-02-07 15:02:58,897 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/783867fd2f62415bbfb8046049b472c6 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,897 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/f5841fdca06d4a4f9a8587b87f44fb78] hfiles 2023-02-07 15:02:58,897 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/f5841fdca06d4a4f9a8587b87f44fb78 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,900 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/04d9399ff8f042b9a2a8f89a76246950, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,901 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/a646ddb125ec4b77a5aa3a5df0f31afa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,902 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9ef9bad482199871438184433fc8a468 in 687ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,902 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9ef9bad482199871438184433fc8a468: 2023-02-07 15:02:58,902 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f2/501b192e51b245e0bba84c262600dc9a as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/501b192e51b245e0bba84c262600dc9a 2023-02-07 15:02:58,903 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,903 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,903 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/90b8fa76f0a742158fe53a01e5a7ba1c] hfiles 2023-02-07 15:02:58,903 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/90b8fa76f0a742158fe53a01e5a7ba1c for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,903 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/04d9399ff8f042b9a2a8f89a76246950] hfiles 2023-02-07 15:02:58,903 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/04d9399ff8f042b9a2a8f89a76246950 for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,911 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/501b192e51b245e0bba84c262600dc9a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:02:58,912 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8732006a08753896dec326564ce25506 in 699ms, sequenceid=5, compaction requested=false 2023-02-07 15:02:58,912 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8732006a08753896dec326564ce25506: 2023-02-07 15:02:58,912 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,912 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:02:58,912 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/a646ddb125ec4b77a5aa3a5df0f31afa] hfiles 2023-02-07 15:02:58,912 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/a646ddb125ec4b77a5aa3a5df0f31afa for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,913 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/501b192e51b245e0bba84c262600dc9a] hfiles 2023-02-07 15:02:58,913 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/501b192e51b245e0bba84c262600dc9a for snapshot=testWithMapReduceMultiRegion 2023-02-07 15:02:58,969 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. completed. 2023-02-07 15:02:58,970 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:58,970 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 15:02:58,979 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. completed. 2023-02-07 15:02:58,979 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:58,979 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 15:02:58,980 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 15:02:58,980 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,980 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-07 15:02:58,980 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36137,1675782173383' in zk 2023-02-07 15:02:58,981 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. completed. 2023-02-07 15:02:58,981 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 15:02:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 15:02:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-07 15:02:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38637,1675782173332' in zk 2023-02-07 15:02:58,984 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-07 15:02:58,984 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,984 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:02:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:02:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:02:58,984 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-07 15:02:58,989 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:02:58,990 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-07 15:02:58,990 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:02:58,990 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-07 15:02:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:02:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:02:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36137,1675782173383': 2023-02-07 15:02:58,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36137,1675782173383' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 15:02:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:02:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:02:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:02:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:02:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:58,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:02:58,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38637,1675782173332': 2023-02-07 15:02:59,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38637,1675782173332' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 15:02:59,000 INFO [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-07 15:02:59,000 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:02:59,000 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:02:59,000 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-07 15:02:59,000 INFO [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 15:02:59,003 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,003 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,003 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:02:59,003 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,003 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:02:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:02:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:02:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:02:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:02:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:02:59,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:02:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:02:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,004 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:02:59,005 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:02:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 15:02:59,007 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,008 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,028 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,028 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 15:02:59,028 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:02:59,028 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:02:59,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-07 15:02:59,028 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:02:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:02:59,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 15:02:59,029 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:02:59,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:02:59,029 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:02:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:02:59,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:02:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:02:59,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:02:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:02:59,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 15:02:59,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-07 15:02:59,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-07 15:02:59,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 15:02:59,163 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 15:02:59,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675782178133Consolidate snapshot: testWithMapReduceMultiRegion at 1675782179029 (+896 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675782179029Writing data manifest for testWithMapReduceMultiRegion at 1675782179065 (+36 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675782179084 (+19 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675782179162 (+78 ms) 2023-02-07 15:02:59,164 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:02:59,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0300 sec 2023-02-07 15:02:59,251 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:02:59,251 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:59,251 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:59,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:02:59,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 15:02:59,254 INFO [Listener at localhost/42259] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 15:02:59,255 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:59,255 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:59,268 INFO [Listener at localhost/42259] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 15:02:59,280 INFO [Listener at localhost/42259] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 15:02:59,341 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38637] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:59,344 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36137] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:59,504 INFO [Listener at localhost/42259] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 15:02:59,519 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:02:59,519 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:02:59,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 15:02:59,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 15:02:59,529 INFO [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 15:02:59,529 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:02:59,529 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 15:02:59,529 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 15:02:59,530 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:02:59,530 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:02:59,531 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:02:59,531 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:02:59,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:02:59,531 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:02:59,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:02:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:02:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:02:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:02:59,532 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:02:59,532 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:02:59,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:02:59,533 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:02:59,534 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:02:59,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:02:59,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:02:59,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:02:59,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:02:59,534 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 15:02:59,534 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 15:02:59,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 15:02:59,540 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 15:02:59,540 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:02:59,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 15:02:59,545 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 15:02:59,548 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 15:02:59,548 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:02:59,564 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 15:02:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. started... 2023-02-07 15:02:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:02:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:59,565 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 15:02:59,565 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7252866e1cfc41cd1e12c0dfa4853f1e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 15:02:59,565 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:02:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. started... 2023-02-07 15:02:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. started... 2023-02-07 15:02:59,565 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8732006a08753896dec326564ce25506 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:02:59,566 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4ed09922affb2fb864cd044e82f5a882 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:02:59,565 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:59,567 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. started... 2023-02-07 15:02:59,567 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3be527e2e29ec8ca9ea716b0c125138e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:02:59,568 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 15:02:59,568 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:59,568 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:02:59,569 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:59,569 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. started... 2023-02-07 15:02:59,570 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. started... 2023-02-07 15:02:59,570 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 55855ecac7fbb082f88e04320f966648: 2023-02-07 15:02:59,571 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:02:59,571 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9ef9bad482199871438184433fc8a468 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:02:59,571 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:02:59,571 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 15:02:59,571 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. started... 2023-02-07 15:02:59,571 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9f98b7b6c1c5a5a713d1b5bd16fc712f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 15:02:59,644 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f1/68e0fe7d086c4e9ca78230b6eb51a222 2023-02-07 15:02:59,650 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f1/5e101380a2d54d0a8db81dab8fbac7ba 2023-02-07 15:02:59,650 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f1/3251225ad0214b6d9de293f33e2189a6 2023-02-07 15:02:59,653 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f1/bbf8fd285f334fe39f24e2fa7bb924de 2023-02-07 15:02:59,704 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f2/e17e357b922f422997634f0b66df6cdc 2023-02-07 15:02:59,707 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f2/208cb26aea25491b8c63c37ebced8afe 2023-02-07 15:02:59,713 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f1/bbf8fd285f334fe39f24e2fa7bb924de as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/bbf8fd285f334fe39f24e2fa7bb924de 2023-02-07 15:02:59,716 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f1/68e0fe7d086c4e9ca78230b6eb51a222 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/68e0fe7d086c4e9ca78230b6eb51a222 2023-02-07 15:02:59,722 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/bbf8fd285f334fe39f24e2fa7bb924de, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,723 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/68e0fe7d086c4e9ca78230b6eb51a222, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,723 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/.tmp/f2/e17e357b922f422997634f0b66df6cdc as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/e17e357b922f422997634f0b66df6cdc 2023-02-07 15:02:59,724 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/.tmp/f2/208cb26aea25491b8c63c37ebced8afe as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/208cb26aea25491b8c63c37ebced8afe 2023-02-07 15:02:59,730 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f2/83d5888d372d43d1abe9069836f45e6e 2023-02-07 15:02:59,731 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/e17e357b922f422997634f0b66df6cdc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,733 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/208cb26aea25491b8c63c37ebced8afe, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,733 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3be527e2e29ec8ca9ea716b0c125138e in 166ms, sequenceid=9, compaction requested=false 2023-02-07 15:02:59,733 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3be527e2e29ec8ca9ea716b0c125138e: 2023-02-07 15:02:59,734 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f2/5084d57855c6486d9480c40cd12b3b52 2023-02-07 15:02:59,734 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:02:59,734 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8732006a08753896dec326564ce25506 in 169ms, sequenceid=9, compaction requested=false 2023-02-07 15:02:59,734 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 15:02:59,734 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:59,734 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8732006a08753896dec326564ce25506: 2023-02-07 15:02:59,735 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:02:59,735 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. started... 2023-02-07 15:02:59,735 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 15:02:59,735 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:59,735 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. started... 2023-02-07 15:02:59,735 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e146a9e07ae15a7e4bc579f6ea4489d6: 2023-02-07 15:02:59,735 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 103665a1d009bf2ff6f6ad114e814ada 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:02:59,735 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:02:59,735 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:59,735 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 15:02:59,736 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. started... 2023-02-07 15:02:59,736 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9bf100dd186f8da978b872e75ccd5feb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:02:59,754 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f1/3251225ad0214b6d9de293f33e2189a6 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/3251225ad0214b6d9de293f33e2189a6 2023-02-07 15:02:59,762 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/3251225ad0214b6d9de293f33e2189a6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,763 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f1/5e101380a2d54d0a8db81dab8fbac7ba as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/5e101380a2d54d0a8db81dab8fbac7ba 2023-02-07 15:02:59,764 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/.tmp/f2/83d5888d372d43d1abe9069836f45e6e as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/83d5888d372d43d1abe9069836f45e6e 2023-02-07 15:02:59,772 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/5e101380a2d54d0a8db81dab8fbac7ba, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:02:59,774 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/.tmp/f2/5084d57855c6486d9480c40cd12b3b52 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/5084d57855c6486d9480c40cd12b3b52 2023-02-07 15:02:59,787 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/83d5888d372d43d1abe9069836f45e6e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,788 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9ef9bad482199871438184433fc8a468 in 217ms, sequenceid=9, compaction requested=false 2023-02-07 15:02:59,789 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9ef9bad482199871438184433fc8a468: 2023-02-07 15:02:59,789 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:02:59,789 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/5084d57855c6486d9480c40cd12b3b52, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:02:59,789 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 15:02:59,790 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7252866e1cfc41cd1e12c0dfa4853f1e in 225ms, sequenceid=9, compaction requested=false 2023-02-07 15:02:59,790 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7252866e1cfc41cd1e12c0dfa4853f1e: 2023-02-07 15:02:59,790 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:02:59,790 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 15:02:59,804 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f1/4568976ea561409e83a19fe3205dc60a 2023-02-07 15:02:59,807 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f1/0ad474f9863247f084e8e513e748e593 2023-02-07 15:02:59,833 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f2/fc30d2528a4641069c044e3c00e8615d 2023-02-07 15:02:59,836 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f2/1217e2fee4f74ae3be4e41d815efbfd0 2023-02-07 15:02:59,842 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f1/4568976ea561409e83a19fe3205dc60a as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/4568976ea561409e83a19fe3205dc60a 2023-02-07 15:02:59,842 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f1/0ad474f9863247f084e8e513e748e593 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/0ad474f9863247f084e8e513e748e593 2023-02-07 15:02:59,849 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/0ad474f9863247f084e8e513e748e593, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,850 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/4568976ea561409e83a19fe3205dc60a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,850 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/.tmp/f2/1217e2fee4f74ae3be4e41d815efbfd0 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/1217e2fee4f74ae3be4e41d815efbfd0 2023-02-07 15:02:59,851 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/.tmp/f2/fc30d2528a4641069c044e3c00e8615d as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/fc30d2528a4641069c044e3c00e8615d 2023-02-07 15:02:59,857 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/1217e2fee4f74ae3be4e41d815efbfd0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,857 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/fc30d2528a4641069c044e3c00e8615d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:02:59,858 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9bf100dd186f8da978b872e75ccd5feb in 122ms, sequenceid=9, compaction requested=false 2023-02-07 15:02:59,858 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9bf100dd186f8da978b872e75ccd5feb: 2023-02-07 15:02:59,858 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 103665a1d009bf2ff6f6ad114e814ada in 123ms, sequenceid=9, compaction requested=false 2023-02-07 15:02:59,858 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:02:59,858 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 103665a1d009bf2ff6f6ad114e814ada: 2023-02-07 15:02:59,858 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 15:02:59,858 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:02:59,859 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 15:03:00,045 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f1/c78d9db8f1d649679c0f653925d42d93 2023-02-07 15:03:00,051 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f1/2b0f1eb882564a89b3a4b5f4f62e6893 2023-02-07 15:03:00,069 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f2/3374620405cb41bbab02b064f6a131a3 2023-02-07 15:03:00,072 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f2/069caff966ab4987b849dddae6f9ecba 2023-02-07 15:03:00,079 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f1/c78d9db8f1d649679c0f653925d42d93 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/c78d9db8f1d649679c0f653925d42d93 2023-02-07 15:03:00,080 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f1/2b0f1eb882564a89b3a4b5f4f62e6893 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/2b0f1eb882564a89b3a4b5f4f62e6893 2023-02-07 15:03:00,085 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/c78d9db8f1d649679c0f653925d42d93, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:00,086 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/.tmp/f2/3374620405cb41bbab02b064f6a131a3 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/3374620405cb41bbab02b064f6a131a3 2023-02-07 15:03:00,087 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/2b0f1eb882564a89b3a4b5f4f62e6893, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:00,088 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/.tmp/f2/069caff966ab4987b849dddae6f9ecba as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/069caff966ab4987b849dddae6f9ecba 2023-02-07 15:03:00,093 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/3374620405cb41bbab02b064f6a131a3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:00,095 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/069caff966ab4987b849dddae6f9ecba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:00,095 INFO [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 9f98b7b6c1c5a5a713d1b5bd16fc712f in 524ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:00,095 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: 2023-02-07 15:03:00,095 DEBUG [rs(jenkins-hbase4.apache.org,36137,1675782173383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:00,095 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 15:03:00,095 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 15:03:00,095 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,095 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 15:03:00,095 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36137,1675782173383' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 15:03:00,096 INFO [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4ed09922affb2fb864cd044e82f5a882 in 529ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:00,096 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4ed09922affb2fb864cd044e82f5a882: 2023-02-07 15:03:00,096 DEBUG [rs(jenkins-hbase4.apache.org,38637,1675782173332)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:00,096 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 15:03:00,096 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 15:03:00,096 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,096 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 15:03:00,096 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38637,1675782173332' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 15:03:00,098 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,098 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:00,099 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:00,099 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,099 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,099 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:00,099 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,099 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:00,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:00,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36137,1675782173383' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 15:03:00,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@722239cd[Count = 1] remaining members to acquire global barrier 2023-02-07 15:03:00,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:00,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:00,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:00,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:00,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:00,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38637,1675782173332' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 15:03:00,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@722239cd[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:00,118 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 15:03:00,118 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,123 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,123 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 15:03:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 15:03:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 15:03:00,124 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 15:03:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36137,1675782173383' in zk 2023-02-07 15:03:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38637,1675782173332' in zk 2023-02-07 15:03:00,124 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,124 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:00,126 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 15:03:00,126 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,126 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:00,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:00,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:00,126 DEBUG [member: 'jenkins-hbase4.apache.org,38637,1675782173332' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 15:03:00,127 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 15:03:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,36137,1675782173383' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 15:03:00,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:00,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38637,1675782173332': 2023-02-07 15:03:00,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38637,1675782173332' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-07 15:03:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:00,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:00,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:00,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36137,1675782173383': 2023-02-07 15:03:00,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36137,1675782173383' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 15:03:00,136 INFO [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 15:03:00,136 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:00,136 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:00,136 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 15:03:00,136 INFO [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 15:03:00,138 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:00,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:00,138 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:00,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:00,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:00,139 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,139 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,142 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:00,142 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:00,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,148 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,148 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:00,148 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:00,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:00,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:00,149 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:00,149 DEBUG [(jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:00,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 15:03:00,149 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:00,148 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:00,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 15:03:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:00,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:00,150 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,150 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:00,150 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:00,150 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,150 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:00,150 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:00,150 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:00,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:00,152 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:00,152 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 15:03:00,252 DEBUG [Listener at localhost/42259] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 15:03:00,253 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:00,253 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:00,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 15:03:00,390 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop-5784134669214467894.jar 2023-02-07 15:03:00,410 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675782178082 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:00,411 DEBUG [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce 2023-02-07 15:03:00,411 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 55855ecac7fbb082f88e04320f966648 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 9ef9bad482199871438184433fc8a468 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 8732006a08753896dec326564ce25506 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(239): region to add: 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=3be527e2e29ec8ca9ea716b0c125138e as 3be527e2e29ec8ca9ea716b0c125138e in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,412 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=7252866e1cfc41cd1e12c0dfa4853f1e as 7252866e1cfc41cd1e12c0dfa4853f1e in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=55855ecac7fbb082f88e04320f966648 as 55855ecac7fbb082f88e04320f966648 in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=9ef9bad482199871438184433fc8a468 as 9ef9bad482199871438184433fc8a468 in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=4ed09922affb2fb864cd044e82f5a882 as 4ed09922affb2fb864cd044e82f5a882 in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=9f98b7b6c1c5a5a713d1b5bd16fc712f as 9f98b7b6c1c5a5a713d1b5bd16fc712f in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=8732006a08753896dec326564ce25506 as 8732006a08753896dec326564ce25506 in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=e146a9e07ae15a7e4bc579f6ea4489d6 as e146a9e07ae15a7e4bc579f6ea4489d6 in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=103665a1d009bf2ff6f6ad114e814ada as 103665a1d009bf2ff6f6ad114e814ada in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,413 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(585): clone region=9bf100dd186f8da978b872e75ccd5feb as 9bf100dd186f8da978b872e75ccd5feb in snapshot testWithMapReduceMultiRegion 2023-02-07 15:03:00,416 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => e146a9e07ae15a7e4bc579f6ea4489d6, NAME => 'testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,416 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3be527e2e29ec8ca9ea716b0c125138e, NAME => 'testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,417 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 8732006a08753896dec326564ce25506, NAME => 'testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,417 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 9f98b7b6c1c5a5a713d1b5bd16fc712f, NAME => 'testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,418 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9ef9bad482199871438184433fc8a468, NAME => 'testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,419 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7252866e1cfc41cd1e12c0dfa4853f1e, NAME => 'testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,419 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 4ed09922affb2fb864cd044e82f5a882, NAME => 'testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,419 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 55855ecac7fbb082f88e04320f966648, NAME => 'testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,457 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,457 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 10098188e90c47fd98e3038a007e832c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,467 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,467 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 783867fd2f62415bbfb8046049b472c6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,472 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b846ec8c2b4a43b18a5cb95abf502505 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 55855ecac7fbb082f88e04320f966648, disabling compactions & flushes 2023-02-07 15:03:00,472 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:00,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:00,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. after waiting 0 ms 2023-02-07 15:03:00,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:00,472 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:00,473 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 55855ecac7fbb082f88e04320f966648: Waiting for close lock at 1675782180472Disabling compacts and flushes for region at 1675782180472Disabling writes for close at 1675782180472Writing region close event to WAL at 1675782180472Closed at 1675782180472 2023-02-07 15:03:00,473 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 103665a1d009bf2ff6f6ad114e814ada, NAME => 'testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,485 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,485 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,485 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74f0b480eafa4b95a8a7036c803ca6c2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,485 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a646ddb125ec4b77a5aa3a5df0f31afa from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,486 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,486 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 90b8fa76f0a742158fe53a01e5a7ba1c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 9f98b7b6c1c5a5a713d1b5bd16fc712f, disabling compactions & flushes 2023-02-07 15:03:00,486 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:00,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:00,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. after waiting 0 ms 2023-02-07 15:03:00,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:00,486 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:00,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: Waiting for close lock at 1675782180486Disabling compacts and flushes for region at 1675782180486Disabling writes for close at 1675782180486Writing region close event to WAL at 1675782180486Closed at 1675782180486 2023-02-07 15:03:00,487 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f5841fdca06d4a4f9a8587b87f44fb78 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,487 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 9bf100dd186f8da978b872e75ccd5feb, NAME => 'testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,492 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,492 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f14fd8e5e2bc4e4dbbf58132c4f93892 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,493 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c55110b195a249f58f9e12d8ce28a2ef from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,497 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3be527e2e29ec8ca9ea716b0c125138e, disabling compactions & flushes 2023-02-07 15:03:00,497 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:00,497 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:00,497 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. after waiting 0 ms 2023-02-07 15:03:00,497 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:00,497 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:00,497 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3be527e2e29ec8ca9ea716b0c125138e: Waiting for close lock at 1675782180497Disabling compacts and flushes for region at 1675782180497Disabling writes for close at 1675782180497Writing region close event to WAL at 1675782180497Closed at 1675782180497 2023-02-07 15:03:00,500 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 04d9399ff8f042b9a2a8f89a76246950 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,500 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,500 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing e146a9e07ae15a7e4bc579f6ea4489d6, disabling compactions & flushes 2023-02-07 15:03:00,500 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:00,500 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:00,500 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. after waiting 0 ms 2023-02-07 15:03:00,500 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:00,500 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:00,500 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for e146a9e07ae15a7e4bc579f6ea4489d6: Waiting for close lock at 1675782180500Disabling compacts and flushes for region at 1675782180500Disabling writes for close at 1675782180500Writing region close event to WAL at 1675782180500Closed at 1675782180500 2023-02-07 15:03:00,504 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,504 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c2ccea970e7f4e0f867d98b72a83f925 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 4ed09922affb2fb864cd044e82f5a882, disabling compactions & flushes 2023-02-07 15:03:00,505 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 501b192e51b245e0bba84c262600dc9a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,505 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9ef9bad482199871438184433fc8a468, disabling compactions & flushes 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. after waiting 0 ms 2023-02-07 15:03:00,505 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:00,505 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. after waiting 0 ms 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 4ed09922affb2fb864cd044e82f5a882: Waiting for close lock at 1675782180505Disabling compacts and flushes for region at 1675782180505Disabling writes for close at 1675782180505Writing region close event to WAL at 1675782180505Closed at 1675782180505 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:00,505 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:00,505 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9ef9bad482199871438184433fc8a468: Waiting for close lock at 1675782180505Disabling compacts and flushes for region at 1675782180505Disabling writes for close at 1675782180505Writing region close event to WAL at 1675782180505Closed at 1675782180505 2023-02-07 15:03:00,509 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 56a39ed907494a4b8304fe41a5c29ff4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,509 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6c01a83433794017b502f67b5a46ac5a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 8732006a08753896dec326564ce25506, disabling compactions & flushes 2023-02-07 15:03:00,509 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:00,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:00,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. after waiting 0 ms 2023-02-07 15:03:00,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:00,509 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:00,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 8732006a08753896dec326564ce25506: Waiting for close lock at 1675782180509Disabling compacts and flushes for region at 1675782180509Disabling writes for close at 1675782180509Writing region close event to WAL at 1675782180509Closed at 1675782180509 2023-02-07 15:03:00,511 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:00,511 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8eefbfd89e2146829bc01453499564e2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,511 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 103665a1d009bf2ff6f6ad114e814ada, disabling compactions & flushes 2023-02-07 15:03:00,511 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. after waiting 0 ms 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:00,512 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 103665a1d009bf2ff6f6ad114e814ada: Waiting for close lock at 1675782180511Disabling compacts and flushes for region at 1675782180511Disabling writes for close at 1675782180512 (+1 ms)Writing region close event to WAL at 1675782180512Closed at 1675782180512 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7252866e1cfc41cd1e12c0dfa4853f1e, disabling compactions & flushes 2023-02-07 15:03:00,512 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. after waiting 0 ms 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:00,512 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:00,512 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7252866e1cfc41cd1e12c0dfa4853f1e: Waiting for close lock at 1675782180512Disabling compacts and flushes for region at 1675782180512Disabling writes for close at 1675782180512Writing region close event to WAL at 1675782180512Closed at 1675782180512 2023-02-07 15:03:00,514 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b45d1d72847f44b69859f1e88856036d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 15:03:00,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 9bf100dd186f8da978b872e75ccd5feb, disabling compactions & flushes 2023-02-07 15:03:00,516 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:00,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:00,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. after waiting 0 ms 2023-02-07 15:03:00,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:00,516 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:00,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 9bf100dd186f8da978b872e75ccd5feb: Waiting for close lock at 1675782180516Disabling compacts and flushes for region at 1675782180516Disabling writes for close at 1675782180516Writing region close event to WAL at 1675782180516Closed at 1675782180516 2023-02-07 15:03:00,516 INFO [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675782178082 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:00,517 DEBUG [Listener at localhost/42259] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,517 DEBUG [Listener at localhost/42259] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac 2023-02-07 15:03:00,517 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-data/ 2023-02-07 15:03:00,518 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----default/ 2023-02-07 15:03:00,518 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 15:03:00,519 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------103665a1d009bf2ff6f6ad114e814ada/ 2023-02-07 15:03:00,519 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,520 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,520 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=103665a1d009bf2ff6f6ad114e814ada-c2ccea970e7f4e0f867d98b72a83f925 2023-02-07 15:03:00,520 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,521 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=103665a1d009bf2ff6f6ad114e814ada-56a39ed907494a4b8304fe41a5c29ff4 2023-02-07 15:03:00,521 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------3be527e2e29ec8ca9ea716b0c125138e/ 2023-02-07 15:03:00,521 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,521 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,522 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=3be527e2e29ec8ca9ea716b0c125138e-783867fd2f62415bbfb8046049b472c6 2023-02-07 15:03:00,522 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,522 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=3be527e2e29ec8ca9ea716b0c125138e-f5841fdca06d4a4f9a8587b87f44fb78 2023-02-07 15:03:00,523 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------4ed09922affb2fb864cd044e82f5a882/ 2023-02-07 15:03:00,523 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,523 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,524 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=4ed09922affb2fb864cd044e82f5a882-74f0b480eafa4b95a8a7036c803ca6c2 2023-02-07 15:03:00,524 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,524 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=4ed09922affb2fb864cd044e82f5a882-c55110b195a249f58f9e12d8ce28a2ef 2023-02-07 15:03:00,524 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------55855ecac7fbb082f88e04320f966648/ 2023-02-07 15:03:00,525 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,525 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------7252866e1cfc41cd1e12c0dfa4853f1e/ 2023-02-07 15:03:00,525 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,525 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,526 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=7252866e1cfc41cd1e12c0dfa4853f1e-f14fd8e5e2bc4e4dbbf58132c4f93892 2023-02-07 15:03:00,526 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,526 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=7252866e1cfc41cd1e12c0dfa4853f1e-6c01a83433794017b502f67b5a46ac5a 2023-02-07 15:03:00,526 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------8732006a08753896dec326564ce25506/ 2023-02-07 15:03:00,527 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,527 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,527 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=8732006a08753896dec326564ce25506-a646ddb125ec4b77a5aa3a5df0f31afa 2023-02-07 15:03:00,527 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,528 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=8732006a08753896dec326564ce25506-501b192e51b245e0bba84c262600dc9a 2023-02-07 15:03:00,528 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------9bf100dd186f8da978b872e75ccd5feb/ 2023-02-07 15:03:00,528 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,528 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,529 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=9bf100dd186f8da978b872e75ccd5feb-8eefbfd89e2146829bc01453499564e2 2023-02-07 15:03:00,529 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,529 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=9bf100dd186f8da978b872e75ccd5feb-b45d1d72847f44b69859f1e88856036d 2023-02-07 15:03:00,529 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------9ef9bad482199871438184433fc8a468/ 2023-02-07 15:03:00,530 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,530 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,530 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=9ef9bad482199871438184433fc8a468-90b8fa76f0a742158fe53a01e5a7ba1c 2023-02-07 15:03:00,530 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,531 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=9ef9bad482199871438184433fc8a468-04d9399ff8f042b9a2a8f89a76246950 2023-02-07 15:03:00,531 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------9f98b7b6c1c5a5a713d1b5bd16fc712f/ 2023-02-07 15:03:00,531 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,532 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:00,532 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=9f98b7b6c1c5a5a713d1b5bd16fc712f-10098188e90c47fd98e3038a007e832c 2023-02-07 15:03:00,532 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:00,533 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |----------------testWithMapReduce=9f98b7b6c1c5a5a713d1b5bd16fc712f-b846ec8c2b4a43b18a5cb95abf502505 2023-02-07 15:03:00,533 DEBUG [Listener at localhost/42259] util.CommonFSUtils(699): |----------e146a9e07ae15a7e4bc579f6ea4489d6/ 2023-02-07 15:03:00,533 DEBUG [Listener at localhost/42259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:00,541 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,541 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,542 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,542 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,542 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,543 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,543 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,612 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop-1369551791159181460.jar 2023-02-07 15:03:00,613 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,613 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,614 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,614 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,615 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,615 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,615 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 15:03:00,616 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 15:03:00,616 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 15:03:00,617 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 15:03:00,617 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 15:03:00,618 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 15:03:00,618 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 15:03:00,618 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 15:03:00,619 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 15:03:00,619 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 15:03:00,625 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:00,625 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:00,625 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 15:03:00,625 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:00,626 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:00,626 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 15:03:00,709 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-07 15:03:00,710 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-07 15:03:00,713 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop-6663470976852424062.jar 2023-02-07 15:03:00,713 DEBUG [Listener at localhost/42259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 15:03:00,765 WARN [Listener at localhost/42259] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 15:03:00,894 INFO [Listener at localhost/42259] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 15:03:01,269 WARN [Listener at localhost/42259] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/mapreduce.cluster.local.dir/1675782181189/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 15:03:01,269 WARN [Listener at localhost/42259] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/mapreduce.cluster.local.dir/1675782181189/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 15:03:01,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:01,429 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:01,431 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:01,433 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:03:01,434 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1 2023-02-07 15:03:01,435 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 103665a1d009bf2ff6f6ad114e814ada columnFamilyName f1 2023-02-07 15:03:01,444 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/testWithMapReduce=103665a1d009bf2ff6f6ad114e814ada-c2ccea970e7f4e0f867d98b72a83f925 2023-02-07 15:03:01,444 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(310): Store=103665a1d009bf2ff6f6ad114e814ada/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,444 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:03:01,445 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2 2023-02-07 15:03:01,446 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 103665a1d009bf2ff6f6ad114e814ada columnFamilyName f2 2023-02-07 15:03:01,451 DEBUG [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/testWithMapReduce=103665a1d009bf2ff6f6ad114e814ada-56a39ed907494a4b8304fe41a5c29ff4 2023-02-07 15:03:01,452 INFO [StoreOpener-103665a1d009bf2ff6f6ad114e814ada-1] regionserver.HStore(310): Store=103665a1d009bf2ff6f6ad114e814ada/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,452 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:01,452 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 103665a1d009bf2ff6f6ad114e814ada; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75170751, jitterRate=0.1201314777135849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:01,452 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 103665a1d009bf2ff6f6ad114e814ada: Writing region info on filesystem at 1675782181431Initializing all the Stores at 1675782181432 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181432Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181433 (+1 ms)Region opened successfully at 1675782181452 (+19 ms) 2023-02-07 15:03:01,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 103665a1d009bf2ff6f6ad114e814ada, disabling compactions & flushes 2023-02-07 15:03:01,627 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:01,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:01,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. after waiting 0 ms 2023-02-07 15:03:01,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:01,632 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:01,632 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 103665a1d009bf2ff6f6ad114e814ada: Waiting for close lock at 1675782181627Disabling compacts and flushes for region at 1675782181627Disabling writes for close at 1675782181627Writing region close event to WAL at 1675782181632 (+5 ms)Closed at 1675782181632 2023-02-07 15:03:01,644 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:01,645 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:01,645 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:01,647 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:03:01,649 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1 2023-02-07 15:03:01,649 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be527e2e29ec8ca9ea716b0c125138e columnFamilyName f1 2023-02-07 15:03:01,657 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/testWithMapReduce=3be527e2e29ec8ca9ea716b0c125138e-783867fd2f62415bbfb8046049b472c6 2023-02-07 15:03:01,657 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(310): Store=3be527e2e29ec8ca9ea716b0c125138e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,658 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:03:01,659 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2 2023-02-07 15:03:01,659 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be527e2e29ec8ca9ea716b0c125138e columnFamilyName f2 2023-02-07 15:03:01,665 DEBUG [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/testWithMapReduce=3be527e2e29ec8ca9ea716b0c125138e-f5841fdca06d4a4f9a8587b87f44fb78 2023-02-07 15:03:01,665 INFO [StoreOpener-3be527e2e29ec8ca9ea716b0c125138e-1] regionserver.HStore(310): Store=3be527e2e29ec8ca9ea716b0c125138e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:01,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3be527e2e29ec8ca9ea716b0c125138e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70321905, jitterRate=0.04787804186344147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:01,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3be527e2e29ec8ca9ea716b0c125138e: Writing region info on filesystem at 1675782181646Initializing all the Stores at 1675782181647 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181647Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181647Region opened successfully at 1675782181666 (+19 ms) 2023-02-07 15:03:01,723 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3be527e2e29ec8ca9ea716b0c125138e, disabling compactions & flushes 2023-02-07 15:03:01,723 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:01,723 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:01,723 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. after waiting 0 ms 2023-02-07 15:03:01,723 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:01,726 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:01,726 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3be527e2e29ec8ca9ea716b0c125138e: Waiting for close lock at 1675782181723Disabling compacts and flushes for region at 1675782181723Disabling writes for close at 1675782181723Writing region close event to WAL at 1675782181726 (+3 ms)Closed at 1675782181726 2023-02-07 15:03:01,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:01,731 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:01,735 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:01,738 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55855ecac7fbb082f88e04320f966648 2023-02-07 15:03:01,741 DEBUG [StoreOpener-55855ecac7fbb082f88e04320f966648-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f1 2023-02-07 15:03:01,741 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55855ecac7fbb082f88e04320f966648 columnFamilyName f1 2023-02-07 15:03:01,742 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(310): Store=55855ecac7fbb082f88e04320f966648/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,742 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55855ecac7fbb082f88e04320f966648 2023-02-07 15:03:01,744 DEBUG [StoreOpener-55855ecac7fbb082f88e04320f966648-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f2 2023-02-07 15:03:01,744 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55855ecac7fbb082f88e04320f966648 columnFamilyName f2 2023-02-07 15:03:01,745 INFO [StoreOpener-55855ecac7fbb082f88e04320f966648-1] regionserver.HStore(310): Store=55855ecac7fbb082f88e04320f966648/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:01,745 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 55855ecac7fbb082f88e04320f966648; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70859382, jitterRate=0.055887073278427124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:01,746 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 55855ecac7fbb082f88e04320f966648: Writing region info on filesystem at 1675782181735Initializing all the Stores at 1675782181737 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181737Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181738 (+1 ms)Region opened successfully at 1675782181746 (+8 ms) 2023-02-07 15:03:01,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 55855ecac7fbb082f88e04320f966648, disabling compactions & flushes 2023-02-07 15:03:01,764 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:01,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:01,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. after waiting 0 ms 2023-02-07 15:03:01,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:01,765 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:01,765 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 55855ecac7fbb082f88e04320f966648: Waiting for close lock at 1675782181764Disabling compacts and flushes for region at 1675782181764Disabling writes for close at 1675782181764Writing region close event to WAL at 1675782181765 (+1 ms)Closed at 1675782181765 2023-02-07 15:03:01,771 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:01,772 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:01,773 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:01,775 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:03:01,776 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1 2023-02-07 15:03:01,777 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed09922affb2fb864cd044e82f5a882 columnFamilyName f1 2023-02-07 15:03:01,784 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/testWithMapReduce=4ed09922affb2fb864cd044e82f5a882-74f0b480eafa4b95a8a7036c803ca6c2 2023-02-07 15:03:01,784 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(310): Store=4ed09922affb2fb864cd044e82f5a882/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,784 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:03:01,785 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2 2023-02-07 15:03:01,786 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed09922affb2fb864cd044e82f5a882 columnFamilyName f2 2023-02-07 15:03:01,792 DEBUG [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/testWithMapReduce=4ed09922affb2fb864cd044e82f5a882-c55110b195a249f58f9e12d8ce28a2ef 2023-02-07 15:03:01,793 INFO [StoreOpener-4ed09922affb2fb864cd044e82f5a882-1] regionserver.HStore(310): Store=4ed09922affb2fb864cd044e82f5a882/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:01,793 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4ed09922affb2fb864cd044e82f5a882; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74149304, jitterRate=0.10491073131561279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:01,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4ed09922affb2fb864cd044e82f5a882: Writing region info on filesystem at 1675782181773Initializing all the Stores at 1675782181774 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181774Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181775 (+1 ms)Region opened successfully at 1675782181793 (+18 ms) 2023-02-07 15:03:01,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4ed09922affb2fb864cd044e82f5a882, disabling compactions & flushes 2023-02-07 15:03:01,844 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:01,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:01,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. after waiting 0 ms 2023-02-07 15:03:01,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:01,847 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:01,847 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4ed09922affb2fb864cd044e82f5a882: Waiting for close lock at 1675782181844Disabling compacts and flushes for region at 1675782181844Disabling writes for close at 1675782181844Writing region close event to WAL at 1675782181847 (+3 ms)Closed at 1675782181847 2023-02-07 15:03:01,852 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:01,852 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:01,860 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:01,862 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:03:01,864 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1 2023-02-07 15:03:01,864 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7252866e1cfc41cd1e12c0dfa4853f1e columnFamilyName f1 2023-02-07 15:03:01,871 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/testWithMapReduce=7252866e1cfc41cd1e12c0dfa4853f1e-f14fd8e5e2bc4e4dbbf58132c4f93892 2023-02-07 15:03:01,871 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(310): Store=7252866e1cfc41cd1e12c0dfa4853f1e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,871 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:03:01,873 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2 2023-02-07 15:03:01,873 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7252866e1cfc41cd1e12c0dfa4853f1e columnFamilyName f2 2023-02-07 15:03:01,879 DEBUG [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/testWithMapReduce=7252866e1cfc41cd1e12c0dfa4853f1e-6c01a83433794017b502f67b5a46ac5a 2023-02-07 15:03:01,879 INFO [StoreOpener-7252866e1cfc41cd1e12c0dfa4853f1e-1] regionserver.HStore(310): Store=7252866e1cfc41cd1e12c0dfa4853f1e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,879 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:01,879 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7252866e1cfc41cd1e12c0dfa4853f1e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61164865, jitterRate=-0.08857248723506927}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:01,879 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7252866e1cfc41cd1e12c0dfa4853f1e: Writing region info on filesystem at 1675782181860Initializing all the Stores at 1675782181861 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181861Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181861Region opened successfully at 1675782181879 (+18 ms) 2023-02-07 15:03:01,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7252866e1cfc41cd1e12c0dfa4853f1e, disabling compactions & flushes 2023-02-07 15:03:01,946 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:01,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:01,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. after waiting 0 ms 2023-02-07 15:03:01,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:01,949 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:01,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7252866e1cfc41cd1e12c0dfa4853f1e: Waiting for close lock at 1675782181946Disabling compacts and flushes for region at 1675782181946Disabling writes for close at 1675782181946Writing region close event to WAL at 1675782181949 (+3 ms)Closed at 1675782181949 2023-02-07 15:03:01,958 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:01,958 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:01,961 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:01,964 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8732006a08753896dec326564ce25506 2023-02-07 15:03:01,965 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1 2023-02-07 15:03:01,966 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8732006a08753896dec326564ce25506 columnFamilyName f1 2023-02-07 15:03:01,973 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/testWithMapReduce=8732006a08753896dec326564ce25506-a646ddb125ec4b77a5aa3a5df0f31afa 2023-02-07 15:03:01,973 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(310): Store=8732006a08753896dec326564ce25506/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,973 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8732006a08753896dec326564ce25506 2023-02-07 15:03:01,974 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2 2023-02-07 15:03:01,975 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8732006a08753896dec326564ce25506 columnFamilyName f2 2023-02-07 15:03:01,982 DEBUG [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/testWithMapReduce=8732006a08753896dec326564ce25506-501b192e51b245e0bba84c262600dc9a 2023-02-07 15:03:01,982 INFO [StoreOpener-8732006a08753896dec326564ce25506-1] regionserver.HStore(310): Store=8732006a08753896dec326564ce25506/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:01,982 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:01,982 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8732006a08753896dec326564ce25506; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68388599, jitterRate=0.01906953752040863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:01,982 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8732006a08753896dec326564ce25506: Writing region info on filesystem at 1675782181962Initializing all the Stores at 1675782181963 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181963Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782181963Region opened successfully at 1675782181982 (+19 ms) 2023-02-07 15:03:02,013 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8732006a08753896dec326564ce25506, disabling compactions & flushes 2023-02-07 15:03:02,013 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:02,013 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:02,013 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. after waiting 0 ms 2023-02-07 15:03:02,013 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:02,017 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:02,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8732006a08753896dec326564ce25506: Waiting for close lock at 1675782182013Disabling compacts and flushes for region at 1675782182013Disabling writes for close at 1675782182013Writing region close event to WAL at 1675782182017 (+4 ms)Closed at 1675782182017 2023-02-07 15:03:02,023 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:02,023 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:02,024 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:02,026 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:03:02,027 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1 2023-02-07 15:03:02,028 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bf100dd186f8da978b872e75ccd5feb columnFamilyName f1 2023-02-07 15:03:02,034 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/testWithMapReduce=9bf100dd186f8da978b872e75ccd5feb-8eefbfd89e2146829bc01453499564e2 2023-02-07 15:03:02,034 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(310): Store=9bf100dd186f8da978b872e75ccd5feb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,035 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:03:02,036 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2 2023-02-07 15:03:02,036 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bf100dd186f8da978b872e75ccd5feb columnFamilyName f2 2023-02-07 15:03:02,042 DEBUG [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/testWithMapReduce=9bf100dd186f8da978b872e75ccd5feb-b45d1d72847f44b69859f1e88856036d 2023-02-07 15:03:02,042 INFO [StoreOpener-9bf100dd186f8da978b872e75ccd5feb-1] regionserver.HStore(310): Store=9bf100dd186f8da978b872e75ccd5feb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,043 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:02,043 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9bf100dd186f8da978b872e75ccd5feb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74678766, jitterRate=0.11280032992362976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:02,043 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9bf100dd186f8da978b872e75ccd5feb: Writing region info on filesystem at 1675782182024Initializing all the Stores at 1675782182025 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182025Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182026 (+1 ms)Region opened successfully at 1675782182043 (+17 ms) 2023-02-07 15:03:02,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9bf100dd186f8da978b872e75ccd5feb, disabling compactions & flushes 2023-02-07 15:03:02,071 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:02,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:02,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. after waiting 0 ms 2023-02-07 15:03:02,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:02,073 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:02,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9bf100dd186f8da978b872e75ccd5feb: Waiting for close lock at 1675782182070Disabling compacts and flushes for region at 1675782182071 (+1 ms)Disabling writes for close at 1675782182071Writing region close event to WAL at 1675782182073 (+2 ms)Closed at 1675782182073 2023-02-07 15:03:02,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:02,079 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:02,084 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:02,086 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ef9bad482199871438184433fc8a468 2023-02-07 15:03:02,087 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1 2023-02-07 15:03:02,087 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ef9bad482199871438184433fc8a468 columnFamilyName f1 2023-02-07 15:03:02,094 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/testWithMapReduce=9ef9bad482199871438184433fc8a468-90b8fa76f0a742158fe53a01e5a7ba1c 2023-02-07 15:03:02,094 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(310): Store=9ef9bad482199871438184433fc8a468/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,095 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ef9bad482199871438184433fc8a468 2023-02-07 15:03:02,096 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2 2023-02-07 15:03:02,096 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ef9bad482199871438184433fc8a468 columnFamilyName f2 2023-02-07 15:03:02,101 DEBUG [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/testWithMapReduce=9ef9bad482199871438184433fc8a468-04d9399ff8f042b9a2a8f89a76246950 2023-02-07 15:03:02,101 INFO [StoreOpener-9ef9bad482199871438184433fc8a468-1] regionserver.HStore(310): Store=9ef9bad482199871438184433fc8a468/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:02,102 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9ef9bad482199871438184433fc8a468; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69704439, jitterRate=0.03867708146572113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:02,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9ef9bad482199871438184433fc8a468: Writing region info on filesystem at 1675782182084Initializing all the Stores at 1675782182085 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182085Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182085Region opened successfully at 1675782182102 (+17 ms) 2023-02-07 15:03:02,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9ef9bad482199871438184433fc8a468, disabling compactions & flushes 2023-02-07 15:03:02,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:02,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:02,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. after waiting 0 ms 2023-02-07 15:03:02,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:02,134 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:02,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9ef9bad482199871438184433fc8a468: Waiting for close lock at 1675782182130Disabling compacts and flushes for region at 1675782182130Disabling writes for close at 1675782182130Writing region close event to WAL at 1675782182134 (+4 ms)Closed at 1675782182134 2023-02-07 15:03:02,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:02,138 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:02,141 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:02,144 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:03:02,145 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1 2023-02-07 15:03:02,146 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f98b7b6c1c5a5a713d1b5bd16fc712f columnFamilyName f1 2023-02-07 15:03:02,152 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/testWithMapReduce=9f98b7b6c1c5a5a713d1b5bd16fc712f-10098188e90c47fd98e3038a007e832c 2023-02-07 15:03:02,152 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(310): Store=9f98b7b6c1c5a5a713d1b5bd16fc712f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,153 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:03:02,154 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2 2023-02-07 15:03:02,154 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f98b7b6c1c5a5a713d1b5bd16fc712f columnFamilyName f2 2023-02-07 15:03:02,160 DEBUG [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(539): loaded hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/testWithMapReduce=9f98b7b6c1c5a5a713d1b5bd16fc712f-b846ec8c2b4a43b18a5cb95abf502505 2023-02-07 15:03:02,160 INFO [StoreOpener-9f98b7b6c1c5a5a713d1b5bd16fc712f-1] regionserver.HStore(310): Store=9f98b7b6c1c5a5a713d1b5bd16fc712f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,160 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:02,161 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9f98b7b6c1c5a5a713d1b5bd16fc712f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64071994, jitterRate=-0.04525288939476013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:02,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: Writing region info on filesystem at 1675782182141Initializing all the Stores at 1675782182142 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182142Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182144 (+2 ms)Region opened successfully at 1675782182161 (+17 ms) 2023-02-07 15:03:02,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9f98b7b6c1c5a5a713d1b5bd16fc712f, disabling compactions & flushes 2023-02-07 15:03:02,222 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:02,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:02,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. after waiting 0 ms 2023-02-07 15:03:02,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:02,224 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:02,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: Waiting for close lock at 1675782182222Disabling compacts and flushes for region at 1675782182222Disabling writes for close at 1675782182222Writing region close event to WAL at 1675782182224 (+2 ms)Closed at 1675782182224 2023-02-07 15:03:02,228 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:02,228 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:02,229 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:02,231 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:03:02,232 DEBUG [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f1 2023-02-07 15:03:02,233 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e146a9e07ae15a7e4bc579f6ea4489d6 columnFamilyName f1 2023-02-07 15:03:02,233 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(310): Store=e146a9e07ae15a7e4bc579f6ea4489d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,233 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:03:02,235 DEBUG [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44653/user/jenkins/test-data/442d0446-bea0-bf00-3f58-7dc855bcf665/testWithMapReduceMultiRegion/66964560-99a6-4693-b40b-6298f58436ac/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f2 2023-02-07 15:03:02,235 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e146a9e07ae15a7e4bc579f6ea4489d6 columnFamilyName f2 2023-02-07 15:03:02,236 INFO [StoreOpener-e146a9e07ae15a7e4bc579f6ea4489d6-1] regionserver.HStore(310): Store=e146a9e07ae15a7e4bc579f6ea4489d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:02,236 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:02,236 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e146a9e07ae15a7e4bc579f6ea4489d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66672497, jitterRate=-0.00650237500667572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:02,236 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e146a9e07ae15a7e4bc579f6ea4489d6: Writing region info on filesystem at 1675782182229Initializing all the Stores at 1675782182230 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182230Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782182230Region opened successfully at 1675782182236 (+6 ms) 2023-02-07 15:03:02,253 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:02,254 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-07 15:03:02,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e146a9e07ae15a7e4bc579f6ea4489d6, disabling compactions & flushes 2023-02-07 15:03:02,269 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:02,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:02,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. after waiting 0 ms 2023-02-07 15:03:02,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:02,270 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:02,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e146a9e07ae15a7e4bc579f6ea4489d6: Waiting for close lock at 1675782182269Disabling compacts and flushes for region at 1675782182269Disabling writes for close at 1675782182269Writing region close event to WAL at 1675782182270 (+1 ms)Closed at 1675782182270 2023-02-07 15:03:03,358 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,358 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-07 15:03:03,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-07 15:03:03,368 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,368 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,369 INFO [Listener at localhost/42259] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 15:03:03,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 15:03:03,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-07 15:03:03,379 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782183379"}]},"ts":"1675782183379"} 2023-02-07 15:03:03,380 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,380 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,382 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-07 15:03:03,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 15:03:03,384 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-07 15:03:03,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e146a9e07ae15a7e4bc579f6ea4489d6, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9f98b7b6c1c5a5a713d1b5bd16fc712f, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed09922affb2fb864cd044e82f5a882, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3be527e2e29ec8ca9ea716b0c125138e, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8732006a08753896dec326564ce25506, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ef9bad482199871438184433fc8a468, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9bf100dd186f8da978b872e75ccd5feb, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=103665a1d009bf2ff6f6ad114e814ada, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7252866e1cfc41cd1e12c0dfa4853f1e, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=55855ecac7fbb082f88e04320f966648, UNASSIGN}] 2023-02-07 15:03:03,389 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=55855ecac7fbb082f88e04320f966648, UNASSIGN 2023-02-07 15:03:03,390 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=103665a1d009bf2ff6f6ad114e814ada, UNASSIGN 2023-02-07 15:03:03,390 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7252866e1cfc41cd1e12c0dfa4853f1e, UNASSIGN 2023-02-07 15:03:03,390 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9bf100dd186f8da978b872e75ccd5feb, UNASSIGN 2023-02-07 15:03:03,390 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ef9bad482199871438184433fc8a468, UNASSIGN 2023-02-07 15:03:03,391 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=55855ecac7fbb082f88e04320f966648, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:03,391 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=103665a1d009bf2ff6f6ad114e814ada, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:03,392 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782183391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183391"}]},"ts":"1675782183391"} 2023-02-07 15:03:03,392 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183391"}]},"ts":"1675782183391"} 2023-02-07 15:03:03,392 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=9ef9bad482199871438184433fc8a468, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:03,392 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7252866e1cfc41cd1e12c0dfa4853f1e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:03,392 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675782176263.9ef9bad482199871438184433fc8a468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183392"}]},"ts":"1675782183392"} 2023-02-07 15:03:03,392 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183392"}]},"ts":"1675782183392"} 2023-02-07 15:03:03,392 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9bf100dd186f8da978b872e75ccd5feb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:03,393 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183392"}]},"ts":"1675782183392"} 2023-02-07 15:03:03,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 55855ecac7fbb082f88e04320f966648, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:03:03,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure 103665a1d009bf2ff6f6ad114e814ada, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:03:03,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=42, state=RUNNABLE; CloseRegionProcedure 7252866e1cfc41cd1e12c0dfa4853f1e, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:03:03,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 9bf100dd186f8da978b872e75ccd5feb, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:03:03,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 9ef9bad482199871438184433fc8a468, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:03:03,407 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8732006a08753896dec326564ce25506, UNASSIGN 2023-02-07 15:03:03,407 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3be527e2e29ec8ca9ea716b0c125138e, UNASSIGN 2023-02-07 15:03:03,407 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed09922affb2fb864cd044e82f5a882, UNASSIGN 2023-02-07 15:03:03,408 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9f98b7b6c1c5a5a713d1b5bd16fc712f, UNASSIGN 2023-02-07 15:03:03,408 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e146a9e07ae15a7e4bc579f6ea4489d6, UNASSIGN 2023-02-07 15:03:03,409 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8732006a08753896dec326564ce25506, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:03,409 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3be527e2e29ec8ca9ea716b0c125138e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:03,409 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675782176263.8732006a08753896dec326564ce25506.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183409"}]},"ts":"1675782183409"} 2023-02-07 15:03:03,409 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183409"}]},"ts":"1675782183409"} 2023-02-07 15:03:03,409 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4ed09922affb2fb864cd044e82f5a882, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:03,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183409"}]},"ts":"1675782183409"} 2023-02-07 15:03:03,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=9f98b7b6c1c5a5a713d1b5bd16fc712f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:03,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183410"}]},"ts":"1675782183410"} 2023-02-07 15:03:03,412 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e146a9e07ae15a7e4bc579f6ea4489d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:03,412 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782183412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782183412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782183412"}]},"ts":"1675782183412"} 2023-02-07 15:03:03,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 8732006a08753896dec326564ce25506, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:03:03,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 3be527e2e29ec8ca9ea716b0c125138e, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:03:03,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 4ed09922affb2fb864cd044e82f5a882, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:03:03,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 9f98b7b6c1c5a5a713d1b5bd16fc712f, server=jenkins-hbase4.apache.org,36137,1675782173383}] 2023-02-07 15:03:03,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure e146a9e07ae15a7e4bc579f6ea4489d6, server=jenkins-hbase4.apache.org,38637,1675782173332}] 2023-02-07 15:03:03,482 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,483 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 15:03:03,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9ef9bad482199871438184433fc8a468 2023-02-07 15:03:03,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:03:03,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9ef9bad482199871438184433fc8a468, disabling compactions & flushes 2023-02-07 15:03:03,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7252866e1cfc41cd1e12c0dfa4853f1e, disabling compactions & flushes 2023-02-07 15:03:03,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:03,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:03,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:03,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:03,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. after waiting 0 ms 2023-02-07 15:03:03,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. after waiting 0 ms 2023-02-07 15:03:03,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:03,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:03,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e. 2023-02-07 15:03:03,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7252866e1cfc41cd1e12c0dfa4853f1e: Waiting for close lock at 1675782183561Running coprocessor pre-close hooks at 1675782183561Disabling compacts and flushes for region at 1675782183561Disabling writes for close at 1675782183562 (+1 ms)Writing region close event to WAL at 1675782183571 (+9 ms)Running coprocessor post-close hooks at 1675782183576 (+5 ms)Closed at 1675782183577 (+1 ms) 2023-02-07 15:03:03,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:03:03,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8732006a08753896dec326564ce25506 2023-02-07 15:03:03,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8732006a08753896dec326564ce25506, disabling compactions & flushes 2023-02-07 15:03:03,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:03,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:03,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. after waiting 0 ms 2023-02-07 15:03:03,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:03,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468. 2023-02-07 15:03:03,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9ef9bad482199871438184433fc8a468: Waiting for close lock at 1675782183561Running coprocessor pre-close hooks at 1675782183561Disabling compacts and flushes for region at 1675782183561Disabling writes for close at 1675782183561Writing region close event to WAL at 1675782183570 (+9 ms)Running coprocessor post-close hooks at 1675782183580 (+10 ms)Closed at 1675782183580 2023-02-07 15:03:03,581 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7252866e1cfc41cd1e12c0dfa4853f1e, regionState=CLOSED 2023-02-07 15:03:03,582 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183581"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183581"}]},"ts":"1675782183581"} 2023-02-07 15:03:03,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9ef9bad482199871438184433fc8a468 2023-02-07 15:03:03,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:03:03,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 103665a1d009bf2ff6f6ad114e814ada, disabling compactions & flushes 2023-02-07 15:03:03,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:03,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:03,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. after waiting 0 ms 2023-02-07 15:03:03,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:03,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=9ef9bad482199871438184433fc8a468, regionState=CLOSED 2023-02-07 15:03:03,585 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675782176263.9ef9bad482199871438184433fc8a468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183584"}]},"ts":"1675782183584"} 2023-02-07 15:03:03,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=42 2023-02-07 15:03:03,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=42, state=SUCCESS; CloseRegionProcedure 7252866e1cfc41cd1e12c0dfa4853f1e, server=jenkins-hbase4.apache.org,38637,1675782173332 in 184 msec 2023-02-07 15:03:03,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7252866e1cfc41cd1e12c0dfa4853f1e, UNASSIGN in 201 msec 2023-02-07 15:03:03,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-07 15:03:03,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 9ef9bad482199871438184433fc8a468, server=jenkins-hbase4.apache.org,36137,1675782173383 in 187 msec 2023-02-07 15:03:03,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ef9bad482199871438184433fc8a468, UNASSIGN in 207 msec 2023-02-07 15:03:03,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506. 2023-02-07 15:03:03,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8732006a08753896dec326564ce25506: Waiting for close lock at 1675782183579Running coprocessor pre-close hooks at 1675782183579Disabling compacts and flushes for region at 1675782183579Disabling writes for close at 1675782183580 (+1 ms)Writing region close event to WAL at 1675782183586 (+6 ms)Running coprocessor post-close hooks at 1675782183594 (+8 ms)Closed at 1675782183595 (+1 ms) 2023-02-07 15:03:03,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada. 2023-02-07 15:03:03,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 103665a1d009bf2ff6f6ad114e814ada: Waiting for close lock at 1675782183583Running coprocessor pre-close hooks at 1675782183583Disabling compacts and flushes for region at 1675782183583Disabling writes for close at 1675782183583Writing region close event to WAL at 1675782183589 (+6 ms)Running coprocessor post-close hooks at 1675782183596 (+7 ms)Closed at 1675782183596 2023-02-07 15:03:03,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8732006a08753896dec326564ce25506 2023-02-07 15:03:03,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:03:03,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4ed09922affb2fb864cd044e82f5a882, disabling compactions & flushes 2023-02-07 15:03:03,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:03,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:03,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. after waiting 0 ms 2023-02-07 15:03:03,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:03,598 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8732006a08753896dec326564ce25506, regionState=CLOSED 2023-02-07 15:03:03,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675782176263.8732006a08753896dec326564ce25506.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183598"}]},"ts":"1675782183598"} 2023-02-07 15:03:03,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:03:03,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:03:03,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3be527e2e29ec8ca9ea716b0c125138e, disabling compactions & flushes 2023-02-07 15:03:03,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:03,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:03,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. after waiting 0 ms 2023-02-07 15:03:03,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:03,610 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=103665a1d009bf2ff6f6ad114e814ada, regionState=CLOSED 2023-02-07 15:03:03,610 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183610"}]},"ts":"1675782183610"} 2023-02-07 15:03:03,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-07 15:03:03,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 8732006a08753896dec326564ce25506, server=jenkins-hbase4.apache.org,38637,1675782173332 in 188 msec 2023-02-07 15:03:03,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8732006a08753896dec326564ce25506, UNASSIGN in 227 msec 2023-02-07 15:03:03,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-07 15:03:03,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure 103665a1d009bf2ff6f6ad114e814ada, server=jenkins-hbase4.apache.org,36137,1675782173383 in 215 msec 2023-02-07 15:03:03,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=103665a1d009bf2ff6f6ad114e814ada, UNASSIGN in 230 msec 2023-02-07 15:03:03,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882. 2023-02-07 15:03:03,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e. 2023-02-07 15:03:03,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4ed09922affb2fb864cd044e82f5a882: Waiting for close lock at 1675782183598Running coprocessor pre-close hooks at 1675782183598Disabling compacts and flushes for region at 1675782183598Disabling writes for close at 1675782183598Writing region close event to WAL at 1675782183623 (+25 ms)Running coprocessor post-close hooks at 1675782183628 (+5 ms)Closed at 1675782183629 (+1 ms) 2023-02-07 15:03:03,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3be527e2e29ec8ca9ea716b0c125138e: Waiting for close lock at 1675782183599Running coprocessor pre-close hooks at 1675782183599Disabling compacts and flushes for region at 1675782183599Disabling writes for close at 1675782183599Writing region close event to WAL at 1675782183624 (+25 ms)Running coprocessor post-close hooks at 1675782183629 (+5 ms)Closed at 1675782183629 2023-02-07 15:03:03,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:03:03,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:03:03,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9bf100dd186f8da978b872e75ccd5feb, disabling compactions & flushes 2023-02-07 15:03:03,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:03,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:03,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. after waiting 0 ms 2023-02-07 15:03:03,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:03,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4ed09922affb2fb864cd044e82f5a882, regionState=CLOSED 2023-02-07 15:03:03,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183632"}]},"ts":"1675782183632"} 2023-02-07 15:03:03,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:03:03,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 55855ecac7fbb082f88e04320f966648 2023-02-07 15:03:03,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 55855ecac7fbb082f88e04320f966648, disabling compactions & flushes 2023-02-07 15:03:03,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:03,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:03,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. after waiting 0 ms 2023-02-07 15:03:03,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:03,634 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3be527e2e29ec8ca9ea716b0c125138e, regionState=CLOSED 2023-02-07 15:03:03,634 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183634"}]},"ts":"1675782183634"} 2023-02-07 15:03:03,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-07 15:03:03,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 4ed09922affb2fb864cd044e82f5a882, server=jenkins-hbase4.apache.org,38637,1675782173332 in 219 msec 2023-02-07 15:03:03,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-07 15:03:03,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 3be527e2e29ec8ca9ea716b0c125138e, server=jenkins-hbase4.apache.org,36137,1675782173383 in 221 msec 2023-02-07 15:03:03,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4ed09922affb2fb864cd044e82f5a882, UNASSIGN in 252 msec 2023-02-07 15:03:03,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3be527e2e29ec8ca9ea716b0c125138e, UNASSIGN in 254 msec 2023-02-07 15:03:03,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 15:03:03,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648. 2023-02-07 15:03:03,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 55855ecac7fbb082f88e04320f966648: Waiting for close lock at 1675782183633Running coprocessor pre-close hooks at 1675782183633Disabling compacts and flushes for region at 1675782183633Disabling writes for close at 1675782183633Writing region close event to WAL at 1675782183636 (+3 ms)Running coprocessor post-close hooks at 1675782183641 (+5 ms)Closed at 1675782183642 (+1 ms) 2023-02-07 15:03:03,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb. 2023-02-07 15:03:03,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9bf100dd186f8da978b872e75ccd5feb: Waiting for close lock at 1675782183632Running coprocessor pre-close hooks at 1675782183632Disabling compacts and flushes for region at 1675782183632Disabling writes for close at 1675782183632Writing region close event to WAL at 1675782183637 (+5 ms)Running coprocessor post-close hooks at 1675782183643 (+6 ms)Closed at 1675782183644 (+1 ms) 2023-02-07 15:03:03,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 55855ecac7fbb082f88e04320f966648 2023-02-07 15:03:03,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:03:03,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9f98b7b6c1c5a5a713d1b5bd16fc712f, disabling compactions & flushes 2023-02-07 15:03:03,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:03,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:03,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. after waiting 0 ms 2023-02-07 15:03:03,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:03,645 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=55855ecac7fbb082f88e04320f966648, regionState=CLOSED 2023-02-07 15:03:03,646 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782183645"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183645"}]},"ts":"1675782183645"} 2023-02-07 15:03:03,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:03:03,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:03:03,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e146a9e07ae15a7e4bc579f6ea4489d6, disabling compactions & flushes 2023-02-07 15:03:03,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:03,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:03,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. after waiting 0 ms 2023-02-07 15:03:03,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:03,646 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9bf100dd186f8da978b872e75ccd5feb, regionState=CLOSED 2023-02-07 15:03:03,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183646"}]},"ts":"1675782183646"} 2023-02-07 15:03:03,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-07 15:03:03,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 55855ecac7fbb082f88e04320f966648, server=jenkins-hbase4.apache.org,36137,1675782173383 in 253 msec 2023-02-07 15:03:03,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-07 15:03:03,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 9bf100dd186f8da978b872e75ccd5feb, server=jenkins-hbase4.apache.org,38637,1675782173332 in 250 msec 2023-02-07 15:03:03,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=55855ecac7fbb082f88e04320f966648, UNASSIGN in 263 msec 2023-02-07 15:03:03,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9bf100dd186f8da978b872e75ccd5feb, UNASSIGN in 266 msec 2023-02-07 15:03:03,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 15:03:03,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:03,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6. 2023-02-07 15:03:03,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e146a9e07ae15a7e4bc579f6ea4489d6: Waiting for close lock at 1675782183646Running coprocessor pre-close hooks at 1675782183646Disabling compacts and flushes for region at 1675782183646Disabling writes for close at 1675782183646Writing region close event to WAL at 1675782183652 (+6 ms)Running coprocessor post-close hooks at 1675782183656 (+4 ms)Closed at 1675782183657 (+1 ms) 2023-02-07 15:03:03,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f. 2023-02-07 15:03:03,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9f98b7b6c1c5a5a713d1b5bd16fc712f: Waiting for close lock at 1675782183645Running coprocessor pre-close hooks at 1675782183645Disabling compacts and flushes for region at 1675782183645Disabling writes for close at 1675782183645Writing region close event to WAL at 1675782183652 (+7 ms)Running coprocessor post-close hooks at 1675782183657 (+5 ms)Closed at 1675782183658 (+1 ms) 2023-02-07 15:03:03,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:03:03,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e146a9e07ae15a7e4bc579f6ea4489d6, regionState=CLOSED 2023-02-07 15:03:03,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782183660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183660"}]},"ts":"1675782183660"} 2023-02-07 15:03:03,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:03:03,661 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=9f98b7b6c1c5a5a713d1b5bd16fc712f, regionState=CLOSED 2023-02-07 15:03:03,661 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782183661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782183661"}]},"ts":"1675782183661"} 2023-02-07 15:03:03,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-07 15:03:03,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure e146a9e07ae15a7e4bc579f6ea4489d6, server=jenkins-hbase4.apache.org,38637,1675782173332 in 244 msec 2023-02-07 15:03:03,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-07 15:03:03,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 9f98b7b6c1c5a5a713d1b5bd16fc712f, server=jenkins-hbase4.apache.org,36137,1675782173383 in 246 msec 2023-02-07 15:03:03,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e146a9e07ae15a7e4bc579f6ea4489d6, UNASSIGN in 280 msec 2023-02-07 15:03:03,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-07 15:03:03,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9f98b7b6c1c5a5a713d1b5bd16fc712f, UNASSIGN in 282 msec 2023-02-07 15:03:03,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782183670"}]},"ts":"1675782183670"} 2023-02-07 15:03:03,671 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-07 15:03:03,673 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-07 15:03:03,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 304 msec 2023-02-07 15:03:03,685 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,685 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 15:03:03,687 INFO [Listener at localhost/42259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-07 15:03:03,688 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,688 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-07 15:03:03,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:03,703 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:03,705 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:03,705 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,705 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 15:03:03,720 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:03:03,720 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:03:03,720 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:03:03,721 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:03:03,721 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506 2023-02-07 15:03:03,721 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468 2023-02-07 15:03:03,721 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:03:03,721 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:03:03,727 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/recovered.edits] 2023-02-07 15:03:03,727 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/recovered.edits] 2023-02-07 15:03:03,727 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/recovered.edits] 2023-02-07 15:03:03,728 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/recovered.edits] 2023-02-07 15:03:03,728 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/recovered.edits] 2023-02-07 15:03:03,728 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/recovered.edits] 2023-02-07 15:03:03,729 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/recovered.edits] 2023-02-07 15:03:03,730 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/recovered.edits] 2023-02-07 15:03:03,740 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/783867fd2f62415bbfb8046049b472c6 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/783867fd2f62415bbfb8046049b472c6 2023-02-07 15:03:03,740 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/10098188e90c47fd98e3038a007e832c to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/10098188e90c47fd98e3038a007e832c 2023-02-07 15:03:03,740 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/2b0f1eb882564a89b3a4b5f4f62e6893 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/2b0f1eb882564a89b3a4b5f4f62e6893 2023-02-07 15:03:03,741 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/4568976ea561409e83a19fe3205dc60a to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/4568976ea561409e83a19fe3205dc60a 2023-02-07 15:03:03,742 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/0ad474f9863247f084e8e513e748e593 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/0ad474f9863247f084e8e513e748e593 2023-02-07 15:03:03,742 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/3251225ad0214b6d9de293f33e2189a6 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/3251225ad0214b6d9de293f33e2189a6 2023-02-07 15:03:03,744 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/c78d9db8f1d649679c0f653925d42d93 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f1/c78d9db8f1d649679c0f653925d42d93 2023-02-07 15:03:03,744 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/bbf8fd285f334fe39f24e2fa7bb924de to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f1/bbf8fd285f334fe39f24e2fa7bb924de 2023-02-07 15:03:03,745 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/74f0b480eafa4b95a8a7036c803ca6c2 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f1/74f0b480eafa4b95a8a7036c803ca6c2 2023-02-07 15:03:03,746 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/68e0fe7d086c4e9ca78230b6eb51a222 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/68e0fe7d086c4e9ca78230b6eb51a222 2023-02-07 15:03:03,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/8eefbfd89e2146829bc01453499564e2 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f1/8eefbfd89e2146829bc01453499564e2 2023-02-07 15:03:03,747 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/c2ccea970e7f4e0f867d98b72a83f925 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f1/c2ccea970e7f4e0f867d98b72a83f925 2023-02-07 15:03:03,748 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/recovered.edits/6.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6/recovered.edits/6.seqid 2023-02-07 15:03:03,748 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/90b8fa76f0a742158fe53a01e5a7ba1c to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f1/90b8fa76f0a742158fe53a01e5a7ba1c 2023-02-07 15:03:03,750 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/e146a9e07ae15a7e4bc579f6ea4489d6 2023-02-07 15:03:03,750 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:03:03,750 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/a646ddb125ec4b77a5aa3a5df0f31afa to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f1/a646ddb125ec4b77a5aa3a5df0f31afa 2023-02-07 15:03:03,755 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/1217e2fee4f74ae3be4e41d815efbfd0 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/1217e2fee4f74ae3be4e41d815efbfd0 2023-02-07 15:03:03,755 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/069caff966ab4987b849dddae6f9ecba to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/069caff966ab4987b849dddae6f9ecba 2023-02-07 15:03:03,755 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/56a39ed907494a4b8304fe41a5c29ff4 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/56a39ed907494a4b8304fe41a5c29ff4 2023-02-07 15:03:03,755 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/3374620405cb41bbab02b064f6a131a3 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/3374620405cb41bbab02b064f6a131a3 2023-02-07 15:03:03,758 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/recovered.edits] 2023-02-07 15:03:03,758 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/e17e357b922f422997634f0b66df6cdc to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/e17e357b922f422997634f0b66df6cdc 2023-02-07 15:03:03,758 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/04d9399ff8f042b9a2a8f89a76246950 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/04d9399ff8f042b9a2a8f89a76246950 2023-02-07 15:03:03,760 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/b45d1d72847f44b69859f1e88856036d to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/f2/b45d1d72847f44b69859f1e88856036d 2023-02-07 15:03:03,761 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/208cb26aea25491b8c63c37ebced8afe to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/208cb26aea25491b8c63c37ebced8afe 2023-02-07 15:03:03,761 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/b846ec8c2b4a43b18a5cb95abf502505 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/f2/b846ec8c2b4a43b18a5cb95abf502505 2023-02-07 15:03:03,761 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/fc30d2528a4641069c044e3c00e8615d to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/f2/fc30d2528a4641069c044e3c00e8615d 2023-02-07 15:03:03,761 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/c55110b195a249f58f9e12d8ce28a2ef to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/f2/c55110b195a249f58f9e12d8ce28a2ef 2023-02-07 15:03:03,764 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/f5841fdca06d4a4f9a8587b87f44fb78 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/f2/f5841fdca06d4a4f9a8587b87f44fb78 2023-02-07 15:03:03,764 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/83d5888d372d43d1abe9069836f45e6e to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/f2/83d5888d372d43d1abe9069836f45e6e 2023-02-07 15:03:03,767 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/501b192e51b245e0bba84c262600dc9a to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/f2/501b192e51b245e0bba84c262600dc9a 2023-02-07 15:03:03,771 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882/recovered.edits/12.seqid 2023-02-07 15:03:03,771 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada/recovered.edits/12.seqid 2023-02-07 15:03:03,772 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/5e101380a2d54d0a8db81dab8fbac7ba to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/5e101380a2d54d0a8db81dab8fbac7ba 2023-02-07 15:03:03,772 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb/recovered.edits/12.seqid 2023-02-07 15:03:03,773 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/4ed09922affb2fb864cd044e82f5a882 2023-02-07 15:03:03,773 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648 2023-02-07 15:03:03,773 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/103665a1d009bf2ff6f6ad114e814ada 2023-02-07 15:03:03,774 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f/recovered.edits/12.seqid 2023-02-07 15:03:03,774 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9bf100dd186f8da978b872e75ccd5feb 2023-02-07 15:03:03,774 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e/recovered.edits/12.seqid 2023-02-07 15:03:03,776 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468/recovered.edits/12.seqid 2023-02-07 15:03:03,777 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9f98b7b6c1c5a5a713d1b5bd16fc712f 2023-02-07 15:03:03,777 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/3be527e2e29ec8ca9ea716b0c125138e 2023-02-07 15:03:03,777 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/9ef9bad482199871438184433fc8a468 2023-02-07 15:03:03,778 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/f14fd8e5e2bc4e4dbbf58132c4f93892 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f1/f14fd8e5e2bc4e4dbbf58132c4f93892 2023-02-07 15:03:03,778 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/8732006a08753896dec326564ce25506/recovered.edits/12.seqid 2023-02-07 15:03:03,778 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f1, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/f2, FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/recovered.edits] 2023-02-07 15:03:03,779 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/8732006a08753896dec326564ce25506 2023-02-07 15:03:03,782 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/5084d57855c6486d9480c40cd12b3b52 to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/5084d57855c6486d9480c40cd12b3b52 2023-02-07 15:03:03,784 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/6c01a83433794017b502f67b5a46ac5a to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/f2/6c01a83433794017b502f67b5a46ac5a 2023-02-07 15:03:03,786 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/recovered.edits/6.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648/recovered.edits/6.seqid 2023-02-07 15:03:03,789 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/55855ecac7fbb082f88e04320f966648 2023-02-07 15:03:03,791 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/recovered.edits/12.seqid to hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/archive/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e/recovered.edits/12.seqid 2023-02-07 15:03:03,791 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/.tmp/data/default/testWithMapReduce/7252866e1cfc41cd1e12c0dfa4853f1e 2023-02-07 15:03:03,791 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 15:03:03,794 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:03,807 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:03,807 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:03,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 15:03:03,820 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-07 15:03:03,825 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-07 15:03:03,826 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:03,826 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675782176263.8732006a08753896dec326564ce25506.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675782176263.9ef9bad482199871438184433fc8a468.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782183827"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,830 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-07 15:03:03,830 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e146a9e07ae15a7e4bc579f6ea4489d6, NAME => 'testWithMapReduce,,1675782176263.e146a9e07ae15a7e4bc579f6ea4489d6.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 9f98b7b6c1c5a5a713d1b5bd16fc712f, NAME => 'testWithMapReduce,aaa,1675782176263.9f98b7b6c1c5a5a713d1b5bd16fc712f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 4ed09922affb2fb864cd044e82f5a882, NAME => 'testWithMapReduce,d\x84\x84,1675782176263.4ed09922affb2fb864cd044e82f5a882.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 3be527e2e29ec8ca9ea716b0c125138e, NAME => 'testWithMapReduce,g\xA7\xA7,1675782176263.3be527e2e29ec8ca9ea716b0c125138e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 8732006a08753896dec326564ce25506, NAME => 'testWithMapReduce,j\xCA\xCA,1675782176263.8732006a08753896dec326564ce25506.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 9ef9bad482199871438184433fc8a468, NAME => 'testWithMapReduce,m\xED\xED,1675782176263.9ef9bad482199871438184433fc8a468.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 9bf100dd186f8da978b872e75ccd5feb, NAME => 'testWithMapReduce,q\x11\x10,1675782176263.9bf100dd186f8da978b872e75ccd5feb.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 103665a1d009bf2ff6f6ad114e814ada, NAME => 'testWithMapReduce,t43,1675782176263.103665a1d009bf2ff6f6ad114e814ada.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 7252866e1cfc41cd1e12c0dfa4853f1e, NAME => 'testWithMapReduce,wWV,1675782176263.7252866e1cfc41cd1e12c0dfa4853f1e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 55855ecac7fbb082f88e04320f966648, NAME => 'testWithMapReduce,zz{,1675782176263.55855ecac7fbb082f88e04320f966648.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-07 15:03:03,831 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-07 15:03:03,831 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675782183831"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:03,833 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-07 15:03:03,835 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:03,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 140 msec 2023-02-07 15:03:04,009 INFO [Listener at localhost/42259] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:04,010 INFO [Listener at localhost/42259] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:04,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 15:03:04,012 INFO [Listener at localhost/42259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-07 15:03:04,012 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 15:03:04,012 INFO [Listener at localhost/42259] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 15:03:04,012 DEBUG [Listener at localhost/42259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f75bdf0 to 127.0.0.1:50408 2023-02-07 15:03:04,012 DEBUG [Listener at localhost/42259] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:04,013 DEBUG [Listener at localhost/42259] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 15:03:04,013 DEBUG [Listener at localhost/42259] util.JVMClusterUtil(257): Found active master hash=481794450, stopped=false 2023-02-07 15:03:04,013 INFO [Listener at localhost/42259] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:03:04,015 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:04,016 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:04,016 INFO [Listener at localhost/42259] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 15:03:04,016 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:04,016 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:04,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:04,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:04,018 DEBUG [Listener at localhost/42259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66cf3e17 to 127.0.0.1:50408 2023-02-07 15:03:04,018 DEBUG [Listener at localhost/42259] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:04,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:04,019 INFO [Listener at localhost/42259] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38637,1675782173332' ***** 2023-02-07 15:03:04,019 INFO [Listener at localhost/42259] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:04,019 INFO [Listener at localhost/42259] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36137,1675782173383' ***** 2023-02-07 15:03:04,019 INFO [Listener at localhost/42259] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:04,019 INFO [RS:0;jenkins-hbase4:38637] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:04,019 INFO [RS:1;jenkins-hbase4:36137] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:04,019 INFO [RS:0;jenkins-hbase4:38637] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:04,019 INFO [RS:1;jenkins-hbase4:36137] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:04,020 INFO [RS:0;jenkins-hbase4:38637] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:04,020 INFO [RS:1;jenkins-hbase4:36137] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:04,020 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:04,020 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:04,028 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:04,028 DEBUG [RS:1;jenkins-hbase4:36137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08da14d2 to 127.0.0.1:50408 2023-02-07 15:03:04,028 DEBUG [RS:1;jenkins-hbase4:36137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:04,029 INFO [RS:1;jenkins-hbase4:36137] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:04,029 INFO [RS:1;jenkins-hbase4:36137] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:04,029 INFO [RS:1;jenkins-hbase4:36137] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:04,029 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 15:03:04,024 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:04,020 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:04,029 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:04,020 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(3304): Received CLOSE for 4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:03:04,029 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:04,029 DEBUG [RS:0;jenkins-hbase4:38637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x339bcf31 to 127.0.0.1:50408 2023-02-07 15:03:04,030 DEBUG [RS:0;jenkins-hbase4:38637] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:04,030 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:04,030 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1479): Online Regions={4286137d1e0b0c442ce2434a967d8849=hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849.} 2023-02-07 15:03:04,029 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 15:03:04,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4286137d1e0b0c442ce2434a967d8849, disabling compactions & flushes 2023-02-07 15:03:04,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:03:04,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:03:04,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. after waiting 0 ms 2023-02-07 15:03:04,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:03:04,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4286137d1e0b0c442ce2434a967d8849 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 15:03:04,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:04,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:04,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:04,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:04,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:04,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-07 15:03:04,032 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:04,033 DEBUG [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1505): Waiting on 4286137d1e0b0c442ce2434a967d8849 2023-02-07 15:03:04,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/.tmp/info/7377eead66274f8e82c161f06bfad77a 2023-02-07 15:03:04,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/.tmp/info/ee5529684b8c4aa89936bc93c94bd464 2023-02-07 15:03:04,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/.tmp/info/7377eead66274f8e82c161f06bfad77a as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/info/7377eead66274f8e82c161f06bfad77a 2023-02-07 15:03:04,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/info/7377eead66274f8e82c161f06bfad77a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 15:03:04,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4286137d1e0b0c442ce2434a967d8849 in 92ms, sequenceid=6, compaction requested=false 2023-02-07 15:03:04,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee5529684b8c4aa89936bc93c94bd464 2023-02-07 15:03:04,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/namespace/4286137d1e0b0c442ce2434a967d8849/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 15:03:04,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:03:04,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4286137d1e0b0c442ce2434a967d8849: Waiting for close lock at 1675782184030Running coprocessor pre-close hooks at 1675782184030Disabling compacts and flushes for region at 1675782184030Disabling writes for close at 1675782184031 (+1 ms)Obtaining lock to block concurrent updates at 1675782184031Preparing flush snapshotting stores in 4286137d1e0b0c442ce2434a967d8849 at 1675782184031Finished memstore snapshotting hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675782184032 (+1 ms)Flushing stores of hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. at 1675782184033 (+1 ms)Flushing 4286137d1e0b0c442ce2434a967d8849/info: creating writer at 1675782184033Flushing 4286137d1e0b0c442ce2434a967d8849/info: appending metadata at 1675782184038 (+5 ms)Flushing 4286137d1e0b0c442ce2434a967d8849/info: closing flushed file at 1675782184039 (+1 ms)Flushing 4286137d1e0b0c442ce2434a967d8849/info: reopening flushed file at 1675782184106 (+67 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4286137d1e0b0c442ce2434a967d8849 in 92ms, sequenceid=6, compaction requested=false at 1675782184123 (+17 ms)Writing region close event to WAL at 1675782184128 (+5 ms)Running coprocessor post-close hooks at 1675782184142 (+14 ms)Closed at 1675782184145 (+3 ms) 2023-02-07 15:03:04,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675782175325.4286137d1e0b0c442ce2434a967d8849. 2023-02-07 15:03:04,232 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:04,233 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38637,1675782173332; all regions closed. 2023-02-07 15:03:04,257 DEBUG [RS:0;jenkins-hbase4:38637] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/oldWALs 2023-02-07 15:03:04,257 INFO [RS:0;jenkins-hbase4:38637] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38637%2C1675782173332:(num 1675782175760) 2023-02-07 15:03:04,257 DEBUG [RS:0;jenkins-hbase4:38637] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:04,257 INFO [RS:0;jenkins-hbase4:38637] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:04,258 INFO [RS:0;jenkins-hbase4:38637] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:04,258 INFO [RS:0;jenkins-hbase4:38637] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:04,258 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:04,258 INFO [RS:0;jenkins-hbase4:38637] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:04,259 INFO [RS:0;jenkins-hbase4:38637] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:04,260 INFO [RS:0;jenkins-hbase4:38637] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38637 2023-02-07 15:03:04,270 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:04,270 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:04,270 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38637,1675782173332 2023-02-07 15:03:04,270 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:04,270 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:04,271 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38637,1675782173332] 2023-02-07 15:03:04,271 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38637,1675782173332; numProcessing=1 2023-02-07 15:03:04,275 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38637,1675782173332 already deleted, retry=false 2023-02-07 15:03:04,275 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38637,1675782173332 expired; onlineServers=1 2023-02-07 15:03:04,433 DEBUG [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:04,523 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:04,523 INFO [RS:0;jenkins-hbase4:38637] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38637,1675782173332; zookeeper connection closed. 2023-02-07 15:03:04,524 ERROR [Listener at localhost/42259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@bacdb00 rejected from java.util.concurrent.ThreadPoolExecutor@f934ead[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:04,524 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c18af0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c18af0 2023-02-07 15:03:04,524 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:38637-0x1002f4e93e20001, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:04,524 ERROR [Listener at localhost/42259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16884079 rejected from java.util.concurrent.ThreadPoolExecutor@f934ead[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:04,560 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/.tmp/rep_barrier/a3f3859d55834709bf794866320a9780 2023-02-07 15:03:04,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3f3859d55834709bf794866320a9780 2023-02-07 15:03:04,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/.tmp/table/35f2c339700a4ac199dd183aa8c85984 2023-02-07 15:03:04,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35f2c339700a4ac199dd183aa8c85984 2023-02-07 15:03:04,591 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/.tmp/info/ee5529684b8c4aa89936bc93c94bd464 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/info/ee5529684b8c4aa89936bc93c94bd464 2023-02-07 15:03:04,598 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee5529684b8c4aa89936bc93c94bd464 2023-02-07 15:03:04,598 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/info/ee5529684b8c4aa89936bc93c94bd464, entries=30, sequenceid=57, filesize=7.9 K 2023-02-07 15:03:04,599 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/.tmp/rep_barrier/a3f3859d55834709bf794866320a9780 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/rep_barrier/a3f3859d55834709bf794866320a9780 2023-02-07 15:03:04,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3f3859d55834709bf794866320a9780 2023-02-07 15:03:04,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/rep_barrier/a3f3859d55834709bf794866320a9780, entries=10, sequenceid=57, filesize=5.9 K 2023-02-07 15:03:04,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/.tmp/table/35f2c339700a4ac199dd183aa8c85984 as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/table/35f2c339700a4ac199dd183aa8c85984 2023-02-07 15:03:04,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35f2c339700a4ac199dd183aa8c85984 2023-02-07 15:03:04,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/table/35f2c339700a4ac199dd183aa8c85984, entries=13, sequenceid=57, filesize=5.9 K 2023-02-07 15:03:04,613 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 581ms, sequenceid=57, compaction requested=false 2023-02-07 15:03:04,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-07 15:03:04,624 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:04,625 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:04,625 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782184029Running coprocessor pre-close hooks at 1675782184029Disabling compacts and flushes for region at 1675782184029Disabling writes for close at 1675782184032 (+3 ms)Obtaining lock to block concurrent updates at 1675782184032Preparing flush snapshotting stores in 1588230740 at 1675782184032Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675782184032Flushing stores of hbase:meta,,1.1588230740 at 1675782184033 (+1 ms)Flushing 1588230740/info: creating writer at 1675782184033Flushing 1588230740/info: appending metadata at 1675782184042 (+9 ms)Flushing 1588230740/info: closing flushed file at 1675782184042Flushing 1588230740/rep_barrier: creating writer at 1675782184127 (+85 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675782184132 (+5 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675782184133 (+1 ms)Flushing 1588230740/table: creating writer at 1675782184568 (+435 ms)Flushing 1588230740/table: appending metadata at 1675782184572 (+4 ms)Flushing 1588230740/table: closing flushed file at 1675782184572Flushing 1588230740/info: reopening flushed file at 1675782184592 (+20 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675782184599 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1675782184606 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 581ms, sequenceid=57, compaction requested=false at 1675782184613 (+7 ms)Writing region close event to WAL at 1675782184620 (+7 ms)Running coprocessor post-close hooks at 1675782184624 (+4 ms)Closed at 1675782184625 (+1 ms) 2023-02-07 15:03:04,625 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:04,633 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36137,1675782173383; all regions closed. 2023-02-07 15:03:04,638 DEBUG [RS:1;jenkins-hbase4:36137] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/oldWALs 2023-02-07 15:03:04,638 INFO [RS:1;jenkins-hbase4:36137] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36137%2C1675782173383.meta:.meta(num 1675782175031) 2023-02-07 15:03:04,645 DEBUG [RS:1;jenkins-hbase4:36137] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/oldWALs 2023-02-07 15:03:04,646 INFO [RS:1;jenkins-hbase4:36137] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36137%2C1675782173383:(num 1675782175760) 2023-02-07 15:03:04,646 DEBUG [RS:1;jenkins-hbase4:36137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:04,646 INFO [RS:1;jenkins-hbase4:36137] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:04,646 INFO [RS:1;jenkins-hbase4:36137] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:04,646 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:04,647 INFO [RS:1;jenkins-hbase4:36137] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36137 2023-02-07 15:03:04,650 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:04,650 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36137,1675782173383 2023-02-07 15:03:04,650 ERROR [Listener at localhost/42259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e4022f5 rejected from java.util.concurrent.ThreadPoolExecutor@7a7fb9e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:04,651 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36137,1675782173383] 2023-02-07 15:03:04,651 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36137,1675782173383; numProcessing=2 2023-02-07 15:03:04,654 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36137,1675782173383 already deleted, retry=false 2023-02-07 15:03:04,654 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36137,1675782173383 expired; onlineServers=0 2023-02-07 15:03:04,654 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34131,1675782172075' ***** 2023-02-07 15:03:04,654 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 15:03:04,655 DEBUG [M:0;jenkins-hbase4:34131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d8a93a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:04,655 INFO [M:0;jenkins-hbase4:34131] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34131,1675782172075 2023-02-07 15:03:04,655 INFO [M:0;jenkins-hbase4:34131] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34131,1675782172075; all regions closed. 2023-02-07 15:03:04,655 DEBUG [M:0;jenkins-hbase4:34131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:04,655 DEBUG [M:0;jenkins-hbase4:34131] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 15:03:04,655 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 15:03:04,655 DEBUG [M:0;jenkins-hbase4:34131] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 15:03:04,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782174498] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782174498,5,FailOnTimeoutGroup] 2023-02-07 15:03:04,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782174498] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782174498,5,FailOnTimeoutGroup] 2023-02-07 15:03:04,658 INFO [M:0;jenkins-hbase4:34131] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 15:03:04,659 INFO [M:0;jenkins-hbase4:34131] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 15:03:04,659 INFO [M:0;jenkins-hbase4:34131] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 15:03:04,659 DEBUG [M:0;jenkins-hbase4:34131] master.HMaster(1502): Stopping service threads 2023-02-07 15:03:04,659 INFO [M:0;jenkins-hbase4:34131] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 15:03:04,660 ERROR [M:0;jenkins-hbase4:34131] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-07 15:03:04,660 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:04,660 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:04,661 INFO [M:0;jenkins-hbase4:34131] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 15:03:04,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:04,661 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 15:03:04,661 DEBUG [M:0;jenkins-hbase4:34131] zookeeper.ZKUtil(398): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 15:03:04,661 WARN [M:0;jenkins-hbase4:34131] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 15:03:04,661 INFO [M:0;jenkins-hbase4:34131] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 15:03:04,662 INFO [M:0;jenkins-hbase4:34131] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 15:03:04,662 DEBUG [M:0;jenkins-hbase4:34131] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:04,662 INFO [M:0;jenkins-hbase4:34131] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:04,662 DEBUG [M:0;jenkins-hbase4:34131] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:04,662 DEBUG [M:0;jenkins-hbase4:34131] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:04,663 DEBUG [M:0;jenkins-hbase4:34131] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:04,663 INFO [M:0;jenkins-hbase4:34131] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.26 KB heapSize=192.19 KB 2023-02-07 15:03:04,692 INFO [M:0;jenkins-hbase4:34131] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.26 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d58c4f066ad149339da72e723486433d 2023-02-07 15:03:04,699 DEBUG [M:0;jenkins-hbase4:34131] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d58c4f066ad149339da72e723486433d as hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d58c4f066ad149339da72e723486433d 2023-02-07 15:03:04,705 INFO [M:0;jenkins-hbase4:34131] regionserver.HStore(1080): Added hdfs://localhost:44653/user/jenkins/test-data/300c9e73-1f63-d642-4c2b-cf6fd25ccc71/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d58c4f066ad149339da72e723486433d, entries=53, sequenceid=357, filesize=10.4 K 2023-02-07 15:03:04,706 INFO [M:0;jenkins-hbase4:34131] regionserver.HRegion(2947): Finished flush of dataSize ~159.26 KB/163086, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 43ms, sequenceid=357, compaction requested=false 2023-02-07 15:03:04,708 INFO [M:0;jenkins-hbase4:34131] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:04,708 DEBUG [M:0;jenkins-hbase4:34131] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782184662Disabling compacts and flushes for region at 1675782184662Disabling writes for close at 1675782184663 (+1 ms)Obtaining lock to block concurrent updates at 1675782184663Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675782184663Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163086, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1675782184663Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675782184664 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675782184664Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675782184669 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675782184669Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675782184700 (+31 ms)Finished flush of dataSize ~159.26 KB/163086, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 43ms, sequenceid=357, compaction requested=false at 1675782184706 (+6 ms)Writing region close event to WAL at 1675782184708 (+2 ms)Closed at 1675782184708 2023-02-07 15:03:04,711 INFO [M:0;jenkins-hbase4:34131] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 15:03:04,711 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:04,712 INFO [M:0;jenkins-hbase4:34131] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34131 2023-02-07 15:03:04,720 DEBUG [M:0;jenkins-hbase4:34131] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34131,1675782172075 already deleted, retry=false 2023-02-07 15:03:04,752 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:04,752 INFO [RS:1;jenkins-hbase4:36137] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36137,1675782173383; zookeeper connection closed. 2023-02-07 15:03:04,752 ERROR [Listener at localhost/42259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@712056ce rejected from java.util.concurrent.ThreadPoolExecutor@7a7fb9e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:04,752 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2cddd00] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2cddd00 2023-02-07 15:03:04,752 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): regionserver:36137-0x1002f4e93e20002, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:04,752 ERROR [Listener at localhost/42259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@93fb530 rejected from java.util.concurrent.ThreadPoolExecutor@7a7fb9e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:04,752 INFO [Listener at localhost/42259] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 15:03:04,852 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:04,852 INFO [M:0;jenkins-hbase4:34131] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34131,1675782172075; zookeeper connection closed. 2023-02-07 15:03:04,852 ERROR [Listener at localhost/42259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e65539d rejected from java.util.concurrent.ThreadPoolExecutor@60582bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:04,852 DEBUG [Listener at localhost/42259-EventThread] zookeeper.ZKWatcher(600): master:34131-0x1002f4e93e20000, quorum=127.0.0.1:50408, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:04,852 ERROR [Listener at localhost/42259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6eb6504a rejected from java.util.concurrent.ThreadPoolExecutor@60582bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:04,854 WARN [Listener at localhost/42259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:04,859 INFO [Listener at localhost/42259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:04,965 WARN [BP-1503413767-172.31.14.131-1675782168533 heartbeating to localhost/127.0.0.1:44653] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:04,965 WARN [BP-1503413767-172.31.14.131-1675782168533 heartbeating to localhost/127.0.0.1:44653] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1503413767-172.31.14.131-1675782168533 (Datanode Uuid a78f2282-a588-4ca0-8541-762bf0e2a927) service to localhost/127.0.0.1:44653 2023-02-07 15:03:04,967 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e/dfs/data/data3/current/BP-1503413767-172.31.14.131-1675782168533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:04,967 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e/dfs/data/data4/current/BP-1503413767-172.31.14.131-1675782168533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:04,969 WARN [Listener at localhost/42259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:04,971 INFO [Listener at localhost/42259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:05,075 WARN [BP-1503413767-172.31.14.131-1675782168533 heartbeating to localhost/127.0.0.1:44653] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:05,075 WARN [BP-1503413767-172.31.14.131-1675782168533 heartbeating to localhost/127.0.0.1:44653] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1503413767-172.31.14.131-1675782168533 (Datanode Uuid 8c372b3a-7000-4249-9627-09a4ec181266) service to localhost/127.0.0.1:44653 2023-02-07 15:03:05,076 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e/dfs/data/data1/current/BP-1503413767-172.31.14.131-1675782168533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:05,076 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/cluster_ed7490f7-0383-be39-e2c5-ebfc90e81f4e/dfs/data/data2/current/BP-1503413767-172.31.14.131-1675782168533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:05,119 INFO [Listener at localhost/42259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:05,244 INFO [Listener at localhost/42259] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 15:03:05,319 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 15:03:05,339 INFO [Listener at localhost/42259] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34131,1675782172075)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:44653 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@5daeab34 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42259 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:44653 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:44653 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:44653 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44653 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:44653 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:44653 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=541 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=356 (was 313) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=5840 (was 6914) 2023-02-07 15:03:05,350 INFO [Listener at localhost/42259] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=541, MaxFileDescriptor=60000, SystemLoadAverage=356, ProcessCount=166, AvailableMemoryMB=5840 2023-02-07 15:03:05,360 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop.log.dir so I do NOT create it in target/test-data/920d61d0-9c83-6b93-c092-312124c9408c 2023-02-07 15:03:05,361 WARN [Listener at localhost/42259] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 15:03:05,361 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop.tmp.dir so I do NOT create it in target/test-data/920d61d0-9c83-6b93-c092-312124c9408c 2023-02-07 15:03:05,361 WARN [Listener at localhost/42259] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e047e0e9-4c4e-a4f9-cc6d-cef26d2b419d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 15:03:05,361 DEBUG [Listener at localhost/42259] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c 2023-02-07 15:03:05,361 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 15:03:05,361 INFO [Listener at localhost/42259] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89, deleteOnExit=true 2023-02-07 15:03:05,361 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 15:03:05,361 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/test.cache.data in system properties and HBase conf 2023-02-07 15:03:05,361 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 15:03:05,362 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop.log.dir in system properties and HBase conf 2023-02-07 15:03:05,362 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 15:03:05,362 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 15:03:05,362 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 15:03:05,362 DEBUG [Listener at localhost/42259] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 15:03:05,362 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:05,362 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:05,363 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 15:03:05,363 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:05,363 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 15:03:05,363 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 15:03:05,363 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:05,363 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:05,363 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 15:03:05,364 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/nfs.dump.dir in system properties and HBase conf 2023-02-07 15:03:05,364 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/java.io.tmpdir in system properties and HBase conf 2023-02-07 15:03:05,364 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:05,364 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 15:03:05,364 INFO [Listener at localhost/42259] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 15:03:05,369 WARN [Listener at localhost/42259] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:05,369 WARN [Listener at localhost/42259] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:05,413 WARN [Listener at localhost/42259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:05,415 INFO [Listener at localhost/42259] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:05,420 INFO [Listener at localhost/42259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/java.io.tmpdir/Jetty_localhost_45559_hdfs____.nhidpa/webapp 2023-02-07 15:03:05,523 INFO [Listener at localhost/42259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45559 2023-02-07 15:03:05,528 WARN [Listener at localhost/42259] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:05,528 WARN [Listener at localhost/42259] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:05,580 WARN [Listener at localhost/46571] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:05,595 WARN [Listener at localhost/46571] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:05,598 WARN [Listener at localhost/46571] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:05,600 INFO [Listener at localhost/46571] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:05,605 INFO [Listener at localhost/46571] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/java.io.tmpdir/Jetty_localhost_34585_datanode____.9i550o/webapp 2023-02-07 15:03:05,703 INFO [Listener at localhost/46571] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34585 2023-02-07 15:03:05,720 WARN [Listener at localhost/34413] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:05,744 WARN [Listener at localhost/34413] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:05,746 WARN [Listener at localhost/34413] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:05,748 INFO [Listener at localhost/34413] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:05,752 INFO [Listener at localhost/34413] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/java.io.tmpdir/Jetty_localhost_46199_datanode____ajxbxy/webapp 2023-02-07 15:03:05,851 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee9e0a68de9341bd: Processing first storage report for DS-977f9841-fd08-4137-8eea-ccd16d1b2b41 from datanode cb353994-c98d-4148-8751-bfbba05db11b 2023-02-07 15:03:05,851 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee9e0a68de9341bd: from storage DS-977f9841-fd08-4137-8eea-ccd16d1b2b41 node DatanodeRegistration(127.0.0.1:35749, datanodeUuid=cb353994-c98d-4148-8751-bfbba05db11b, infoPort=41683, infoSecurePort=0, ipcPort=34413, storageInfo=lv=-57;cid=testClusterID;nsid=724147575;c=1675782185372), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:05,852 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee9e0a68de9341bd: Processing first storage report for DS-43980b1b-d6e9-4b9b-b630-3eebcba109c2 from datanode cb353994-c98d-4148-8751-bfbba05db11b 2023-02-07 15:03:05,852 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee9e0a68de9341bd: from storage DS-43980b1b-d6e9-4b9b-b630-3eebcba109c2 node DatanodeRegistration(127.0.0.1:35749, datanodeUuid=cb353994-c98d-4148-8751-bfbba05db11b, infoPort=41683, infoSecurePort=0, ipcPort=34413, storageInfo=lv=-57;cid=testClusterID;nsid=724147575;c=1675782185372), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:05,867 INFO [Listener at localhost/34413] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46199 2023-02-07 15:03:05,878 WARN [Listener at localhost/45505] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:05,989 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6600dd1236b8f050: Processing first storage report for DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938 from datanode 6bd346d7-ee65-4d5e-9b29-e8a5083bdf63 2023-02-07 15:03:05,989 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6600dd1236b8f050: from storage DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938 node DatanodeRegistration(127.0.0.1:39741, datanodeUuid=6bd346d7-ee65-4d5e-9b29-e8a5083bdf63, infoPort=37233, infoSecurePort=0, ipcPort=45505, storageInfo=lv=-57;cid=testClusterID;nsid=724147575;c=1675782185372), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:05,989 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6600dd1236b8f050: Processing first storage report for DS-3734cb2f-f5a2-4c47-88a4-8327169a2944 from datanode 6bd346d7-ee65-4d5e-9b29-e8a5083bdf63 2023-02-07 15:03:05,989 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6600dd1236b8f050: from storage DS-3734cb2f-f5a2-4c47-88a4-8327169a2944 node DatanodeRegistration(127.0.0.1:39741, datanodeUuid=6bd346d7-ee65-4d5e-9b29-e8a5083bdf63, infoPort=37233, infoSecurePort=0, ipcPort=45505, storageInfo=lv=-57;cid=testClusterID;nsid=724147575;c=1675782185372), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:06,087 DEBUG [Listener at localhost/45505] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c 2023-02-07 15:03:06,090 INFO [Listener at localhost/45505] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89/zookeeper_0, clientPort=58177, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 15:03:06,091 INFO [Listener at localhost/45505] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58177 2023-02-07 15:03:06,091 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,093 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,113 INFO [Listener at localhost/45505] util.FSUtils(479): Created version file at hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417 with version=8 2023-02-07 15:03:06,113 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,114 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,116 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/hbase-staging 2023-02-07 15:03:06,118 INFO [Listener at localhost/45505] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:06,119 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,119 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,119 INFO [Listener at localhost/45505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:06,119 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,119 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:06,119 INFO [Listener at localhost/45505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:06,121 INFO [Listener at localhost/45505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36585 2023-02-07 15:03:06,122 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,123 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,124 INFO [Listener at localhost/45505] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36585 connecting to ZooKeeper ensemble=127.0.0.1:58177 2023-02-07 15:03:06,132 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:365850x0, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:06,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36585-0x1002f4ece2e0000 connected 2023-02-07 15:03:06,150 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:06,150 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:06,151 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:06,156 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36585 2023-02-07 15:03:06,156 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36585 2023-02-07 15:03:06,156 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36585 2023-02-07 15:03:06,160 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36585 2023-02-07 15:03:06,160 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36585 2023-02-07 15:03:06,160 INFO [Listener at localhost/45505] master.HMaster(439): hbase.rootdir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417, hbase.cluster.distributed=false 2023-02-07 15:03:06,183 INFO [Listener at localhost/45505] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:06,184 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,184 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,184 INFO [Listener at localhost/45505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:06,185 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,185 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:06,185 INFO [Listener at localhost/45505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:06,191 INFO [Listener at localhost/45505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35599 2023-02-07 15:03:06,192 INFO [Listener at localhost/45505] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:06,193 DEBUG [Listener at localhost/45505] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:06,194 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,195 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,196 INFO [Listener at localhost/45505] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35599 connecting to ZooKeeper ensemble=127.0.0.1:58177 2023-02-07 15:03:06,201 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:355990x0, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:06,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35599-0x1002f4ece2e0001 connected 2023-02-07 15:03:06,202 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:06,202 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:06,203 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:06,208 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35599 2023-02-07 15:03:06,208 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35599 2023-02-07 15:03:06,208 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35599 2023-02-07 15:03:06,209 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35599 2023-02-07 15:03:06,209 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35599 2023-02-07 15:03:06,222 INFO [Listener at localhost/45505] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:06,222 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,222 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,222 INFO [Listener at localhost/45505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:06,222 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:06,222 INFO [Listener at localhost/45505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:06,223 INFO [Listener at localhost/45505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:06,225 INFO [Listener at localhost/45505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40983 2023-02-07 15:03:06,225 INFO [Listener at localhost/45505] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:06,227 DEBUG [Listener at localhost/45505] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:06,227 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,229 INFO [Listener at localhost/45505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,230 INFO [Listener at localhost/45505] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40983 connecting to ZooKeeper ensemble=127.0.0.1:58177 2023-02-07 15:03:06,235 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:409830x0, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:06,236 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): regionserver:409830x0, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:06,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40983-0x1002f4ece2e0002 connected 2023-02-07 15:03:06,237 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:06,238 DEBUG [Listener at localhost/45505] zookeeper.ZKUtil(164): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:06,240 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40983 2023-02-07 15:03:06,240 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40983 2023-02-07 15:03:06,240 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40983 2023-02-07 15:03:06,241 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40983 2023-02-07 15:03:06,244 DEBUG [Listener at localhost/45505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40983 2023-02-07 15:03:06,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:06,247 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:06,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:06,248 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:06,248 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:06,248 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:06,249 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:06,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:06,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36585,1675782186118 from backup master directory 2023-02-07 15:03:06,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:06,254 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:06,254 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:06,254 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:06,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:06,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/hbase.id with ID: 3aa66291-e59b-4f03-8fb2-30c8fd22ece7 2023-02-07 15:03:06,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:06,292 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:06,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4192dbe7 to 127.0.0.1:58177 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:06,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4686cc38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:06,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:06,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 15:03:06,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:06,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store-tmp 2023-02-07 15:03:06,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:06,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:06,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:06,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:06,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:06,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:06,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:06,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782186322Disabling compacts and flushes for region at 1675782186322Disabling writes for close at 1675782186323 (+1 ms)Writing region close event to WAL at 1675782186323Closed at 1675782186323 2023-02-07 15:03:06,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/WALs/jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:06,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36585%2C1675782186118, suffix=, logDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/WALs/jenkins-hbase4.apache.org,36585,1675782186118, archiveDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/oldWALs, maxLogs=10 2023-02-07 15:03:06,352 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK] 2023-02-07 15:03:06,354 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK] 2023-02-07 15:03:06,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/WALs/jenkins-hbase4.apache.org,36585,1675782186118/jenkins-hbase4.apache.org%2C36585%2C1675782186118.1675782186326 2023-02-07 15:03:06,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK], DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK]] 2023-02-07 15:03:06,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:06,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:06,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:06,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:06,359 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:06,360 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 15:03:06,361 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 15:03:06,361 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:06,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:06,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:06,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:06,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:06,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60409871, jitterRate=-0.09982277452945709}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:06,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675782186357Initializing all the Stores at 1675782186358 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782186358Cleaning up temporary data from old regions at 1675782186363 (+5 ms)Cleaning up detritus from prior splits at 1675782186363Region opened successfully at 1675782186368 (+5 ms) 2023-02-07 15:03:06,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 15:03:06,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 15:03:06,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 15:03:06,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 15:03:06,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 15:03:06,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 15:03:06,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 15:03:06,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 15:03:06,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 15:03:06,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 15:03:06,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 15:03:06,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 15:03:06,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 15:03:06,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 15:03:06,394 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:06,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 15:03:06,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 15:03:06,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 15:03:06,399 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:06,399 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:06,399 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:06,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36585,1675782186118, sessionid=0x1002f4ece2e0000, setting cluster-up flag (Was=false) 2023-02-07 15:03:06,400 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:06,405 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:06,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 15:03:06,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:06,417 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:06,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 15:03:06,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:06,423 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.hbase-snapshot/.tmp 2023-02-07 15:03:06,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675782216433 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 15:03:06,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 15:03:06,434 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:06,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 15:03:06,434 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 15:03:06,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 15:03:06,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 15:03:06,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 15:03:06,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782186435,5,FailOnTimeoutGroup] 2023-02-07 15:03:06,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782186435,5,FailOnTimeoutGroup] 2023-02-07 15:03:06,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 15:03:06,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,436 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:06,447 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(952): ClusterId : 3aa66291-e59b-4f03-8fb2-30c8fd22ece7 2023-02-07 15:03:06,447 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:06,447 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(952): ClusterId : 3aa66291-e59b-4f03-8fb2-30c8fd22ece7 2023-02-07 15:03:06,447 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:06,451 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:06,451 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:06,451 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:06,452 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:06,452 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:06,452 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:06,452 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417 2023-02-07 15:03:06,453 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:06,455 DEBUG [RS:1;jenkins-hbase4:40983] zookeeper.ReadOnlyZKClient(139): Connect 0x025c0571 to 127.0.0.1:58177 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:06,455 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:06,457 DEBUG [RS:0;jenkins-hbase4:35599] zookeeper.ReadOnlyZKClient(139): Connect 0x706d55b5 to 127.0.0.1:58177 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:06,469 DEBUG [RS:1;jenkins-hbase4:40983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c9beb4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:06,469 DEBUG [RS:1;jenkins-hbase4:40983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8a46e01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:06,476 DEBUG [RS:0;jenkins-hbase4:35599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eaaa5c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:06,476 DEBUG [RS:0;jenkins-hbase4:35599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a953ec5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:06,479 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:06,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:06,481 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40983 2023-02-07 15:03:06,481 INFO [RS:1;jenkins-hbase4:40983] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:06,481 INFO [RS:1;jenkins-hbase4:40983] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:06,481 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:06,481 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/info 2023-02-07 15:03:06,482 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36585,1675782186118 with isa=jenkins-hbase4.apache.org/172.31.14.131:40983, startcode=1675782186221 2023-02-07 15:03:06,482 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:06,482 DEBUG [RS:1;jenkins-hbase4:40983] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:06,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:06,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:06,486 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38665, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:06,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,488 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:06,488 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:06,488 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417 2023-02-07 15:03:06,488 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46571 2023-02-07 15:03:06,488 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:06,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:06,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:06,490 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:06,491 DEBUG [RS:1;jenkins-hbase4:40983] zookeeper.ZKUtil(162): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,491 WARN [RS:1;jenkins-hbase4:40983] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:06,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/table 2023-02-07 15:03:06,491 INFO [RS:1;jenkins-hbase4:40983] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:06,491 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35599 2023-02-07 15:03:06,491 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,492 INFO [RS:0;jenkins-hbase4:35599] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:06,492 INFO [RS:0;jenkins-hbase4:35599] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:06,492 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:06,492 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:06,492 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40983,1675782186221] 2023-02-07 15:03:06,492 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36585,1675782186118 with isa=jenkins-hbase4.apache.org/172.31.14.131:35599, startcode=1675782186183 2023-02-07 15:03:06,492 DEBUG [RS:0;jenkins-hbase4:35599] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:06,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:06,498 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740 2023-02-07 15:03:06,498 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740 2023-02-07 15:03:06,501 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:06,503 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34945, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:06,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,504 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417 2023-02-07 15:03:06,504 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:06,504 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46571 2023-02-07 15:03:06,505 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:06,504 DEBUG [RS:1;jenkins-hbase4:40983] zookeeper.ZKUtil(162): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,507 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:06,508 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73130483, jitterRate=0.08972911536693573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:06,508 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675782186479Initializing all the Stores at 1675782186480 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782186480Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782186480Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782186480Cleaning up temporary data from old regions at 1675782186499 (+19 ms)Cleaning up detritus from prior splits at 1675782186499Region opened successfully at 1675782186508 (+9 ms) 2023-02-07 15:03:06,508 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:06,508 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:06,508 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:06,508 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:06,508 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:06,511 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:06,511 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:06,511 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:06,512 INFO [RS:1;jenkins-hbase4:40983] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:06,512 DEBUG [RS:0;jenkins-hbase4:35599] zookeeper.ZKUtil(162): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,512 WARN [RS:0;jenkins-hbase4:35599] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:06,512 INFO [RS:0;jenkins-hbase4:35599] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:06,512 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,516 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:06,516 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782186508Disabling compacts and flushes for region at 1675782186508Disabling writes for close at 1675782186508Writing region close event to WAL at 1675782186516 (+8 ms)Closed at 1675782186516 2023-02-07 15:03:06,516 INFO [RS:1;jenkins-hbase4:40983] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:06,517 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35599,1675782186183] 2023-02-07 15:03:06,517 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:06,517 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 15:03:06,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 15:03:06,521 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 15:03:06,521 INFO [RS:1;jenkins-hbase4:40983] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:06,521 INFO [RS:1;jenkins-hbase4:40983] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,523 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:06,524 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 15:03:06,525 INFO [RS:1;jenkins-hbase4:40983] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,525 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,525 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,525 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,525 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,525 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,525 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:06,525 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,526 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,526 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,526 DEBUG [RS:1;jenkins-hbase4:40983] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,526 DEBUG [RS:0;jenkins-hbase4:35599] zookeeper.ZKUtil(162): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,526 DEBUG [RS:0;jenkins-hbase4:35599] zookeeper.ZKUtil(162): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,527 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:06,528 INFO [RS:0;jenkins-hbase4:35599] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:06,533 INFO [RS:0;jenkins-hbase4:35599] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:06,536 INFO [RS:1;jenkins-hbase4:40983] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,536 INFO [RS:1;jenkins-hbase4:40983] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,536 INFO [RS:0;jenkins-hbase4:35599] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:06,536 INFO [RS:1;jenkins-hbase4:40983] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,536 INFO [RS:0;jenkins-hbase4:35599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,540 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:06,542 INFO [RS:0;jenkins-hbase4:35599] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,542 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,543 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,543 DEBUG [RS:0;jenkins-hbase4:35599] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:06,544 INFO [RS:0;jenkins-hbase4:35599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,544 INFO [RS:0;jenkins-hbase4:35599] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,544 INFO [RS:0;jenkins-hbase4:35599] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,553 INFO [RS:1;jenkins-hbase4:40983] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:06,553 INFO [RS:1;jenkins-hbase4:40983] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40983,1675782186221-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,558 INFO [RS:0;jenkins-hbase4:35599] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:06,558 INFO [RS:0;jenkins-hbase4:35599] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35599,1675782186183-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,571 INFO [RS:1;jenkins-hbase4:40983] regionserver.Replication(203): jenkins-hbase4.apache.org,40983,1675782186221 started 2023-02-07 15:03:06,571 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40983,1675782186221, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40983, sessionid=0x1002f4ece2e0002 2023-02-07 15:03:06,571 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:06,571 DEBUG [RS:1;jenkins-hbase4:40983] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,571 DEBUG [RS:1;jenkins-hbase4:40983] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40983,1675782186221' 2023-02-07 15:03:06,571 DEBUG [RS:1;jenkins-hbase4:40983] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:06,572 DEBUG [RS:1;jenkins-hbase4:40983] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:06,573 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:06,573 INFO [RS:0;jenkins-hbase4:35599] regionserver.Replication(203): jenkins-hbase4.apache.org,35599,1675782186183 started 2023-02-07 15:03:06,573 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:06,573 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35599,1675782186183, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35599, sessionid=0x1002f4ece2e0001 2023-02-07 15:03:06,573 DEBUG [RS:1;jenkins-hbase4:40983] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:06,573 DEBUG [RS:1;jenkins-hbase4:40983] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40983,1675782186221' 2023-02-07 15:03:06,573 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:06,573 DEBUG [RS:0;jenkins-hbase4:35599] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,573 DEBUG [RS:0;jenkins-hbase4:35599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35599,1675782186183' 2023-02-07 15:03:06,573 DEBUG [RS:0;jenkins-hbase4:35599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:06,573 DEBUG [RS:1;jenkins-hbase4:40983] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:06,574 DEBUG [RS:0;jenkins-hbase4:35599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:06,574 DEBUG [RS:1;jenkins-hbase4:40983] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:06,574 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:06,574 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:06,574 DEBUG [RS:0;jenkins-hbase4:35599] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,574 DEBUG [RS:0;jenkins-hbase4:35599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35599,1675782186183' 2023-02-07 15:03:06,574 DEBUG [RS:0;jenkins-hbase4:35599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:06,574 DEBUG [RS:1;jenkins-hbase4:40983] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:06,574 INFO [RS:1;jenkins-hbase4:40983] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:06,574 INFO [RS:1;jenkins-hbase4:40983] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:06,574 DEBUG [RS:0;jenkins-hbase4:35599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:06,575 DEBUG [RS:0;jenkins-hbase4:35599] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:06,575 INFO [RS:0;jenkins-hbase4:35599] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:06,575 INFO [RS:0;jenkins-hbase4:35599] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:06,675 DEBUG [jenkins-hbase4:36585] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 15:03:06,675 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:06,677 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:06,677 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:06,677 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:06,678 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35599,1675782186183, state=OPENING 2023-02-07 15:03:06,680 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 15:03:06,682 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:06,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35599,1675782186183}] 2023-02-07 15:03:06,682 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:06,837 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:06,837 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:06,841 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55832, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:06,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 15:03:06,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:06,846 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35599%2C1675782186183.meta, suffix=.meta, logDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,35599,1675782186183, archiveDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/oldWALs, maxLogs=32 2023-02-07 15:03:06,865 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK] 2023-02-07 15:03:06,865 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK] 2023-02-07 15:03:06,867 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,35599,1675782186183/jenkins-hbase4.apache.org%2C35599%2C1675782186183.meta.1675782186847.meta 2023-02-07 15:03:06,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK], DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK]] 2023-02-07 15:03:06,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:06,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 15:03:06,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 15:03:06,869 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 15:03:06,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 15:03:06,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:06,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 15:03:06,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 15:03:06,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:06,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/info 2023-02-07 15:03:06,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/info 2023-02-07 15:03:06,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:06,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:06,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:06,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:06,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:06,874 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:06,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:06,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:06,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/table 2023-02-07 15:03:06,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/table 2023-02-07 15:03:06,876 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:06,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:06,877 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740 2023-02-07 15:03:06,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740 2023-02-07 15:03:06,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:06,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:06,883 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74067464, jitterRate=0.1036912202835083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:06,883 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675782186869Writing region info on filesystem at 1675782186869Initializing all the Stores at 1675782186870 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782186870Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782186870Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782186870Cleaning up temporary data from old regions at 1675782186879 (+9 ms)Cleaning up detritus from prior splits at 1675782186880 (+1 ms)Running coprocessor post-open hooks at 1675782186883 (+3 ms)Region opened successfully at 1675782186883 2023-02-07 15:03:06,884 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675782186837 2023-02-07 15:03:06,887 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 15:03:06,888 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 15:03:06,888 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35599,1675782186183, state=OPEN 2023-02-07 15:03:06,890 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 15:03:06,890 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:06,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 15:03:06,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35599,1675782186183 in 208 msec 2023-02-07 15:03:06,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 15:03:06,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 375 msec 2023-02-07 15:03:06,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 472 msec 2023-02-07 15:03:06,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675782186247, completionTime=-1 2023-02-07 15:03:06,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 15:03:06,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 15:03:06,899 DEBUG [hconnection-0x6c451e37-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:06,902 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55834, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:06,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 15:03:06,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675782246904 2023-02-07 15:03:06,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675782306904 2023-02-07 15:03:06,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-07 15:03:06,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1675782186118-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1675782186118-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1675782186118-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36585, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:06,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 15:03:06,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:06,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 15:03:06,914 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 15:03:06,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:06,916 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:06,918 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:06,918 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff empty. 2023-02-07 15:03:06,919 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:06,919 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 15:03:06,931 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:06,933 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e5e1a382a5128222ac9c9beaffd3a7ff, NAME => 'hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:07,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:07,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e5e1a382a5128222ac9c9beaffd3a7ff, disabling compactions & flushes 2023-02-07 15:03:07,341 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:07,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:07,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. after waiting 0 ms 2023-02-07 15:03:07,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:07,341 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:07,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e5e1a382a5128222ac9c9beaffd3a7ff: Waiting for close lock at 1675782187341Disabling compacts and flushes for region at 1675782187341Disabling writes for close at 1675782187341Writing region close event to WAL at 1675782187341Closed at 1675782187341 2023-02-07 15:03:07,344 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:07,346 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782187345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782187345"}]},"ts":"1675782187345"} 2023-02-07 15:03:07,348 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:07,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:07,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782187349"}]},"ts":"1675782187349"} 2023-02-07 15:03:07,351 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 15:03:07,354 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:07,355 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:07,355 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:07,355 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:07,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e5e1a382a5128222ac9c9beaffd3a7ff, ASSIGN}] 2023-02-07 15:03:07,358 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e5e1a382a5128222ac9c9beaffd3a7ff, ASSIGN 2023-02-07 15:03:07,359 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e5e1a382a5128222ac9c9beaffd3a7ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35599,1675782186183; forceNewPlan=false, retain=false 2023-02-07 15:03:07,510 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:07,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e5e1a382a5128222ac9c9beaffd3a7ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:07,512 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782187512"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782187512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782187512"}]},"ts":"1675782187512"} 2023-02-07 15:03:07,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e5e1a382a5128222ac9c9beaffd3a7ff, server=jenkins-hbase4.apache.org,35599,1675782186183}] 2023-02-07 15:03:07,577 INFO [RS:1;jenkins-hbase4:40983] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40983%2C1675782186221, suffix=, logDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,40983,1675782186221, archiveDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/oldWALs, maxLogs=32 2023-02-07 15:03:07,577 INFO [RS:0;jenkins-hbase4:35599] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35599%2C1675782186183, suffix=, logDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,35599,1675782186183, archiveDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/oldWALs, maxLogs=32 2023-02-07 15:03:07,596 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK] 2023-02-07 15:03:07,596 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK] 2023-02-07 15:03:07,600 INFO [RS:1;jenkins-hbase4:40983] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,40983,1675782186221/jenkins-hbase4.apache.org%2C40983%2C1675782186221.1675782187577 2023-02-07 15:03:07,601 DEBUG [RS:1;jenkins-hbase4:40983] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK], DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK]] 2023-02-07 15:03:07,606 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK] 2023-02-07 15:03:07,610 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK] 2023-02-07 15:03:07,612 INFO [RS:0;jenkins-hbase4:35599] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,35599,1675782186183/jenkins-hbase4.apache.org%2C35599%2C1675782186183.1675782187578 2023-02-07 15:03:07,616 DEBUG [RS:0;jenkins-hbase4:35599] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39741,DS-3d209f53-fbfe-4e30-9d5d-5e4062ce1938,DISK], DatanodeInfoWithStorage[127.0.0.1:35749,DS-977f9841-fd08-4137-8eea-ccd16d1b2b41,DISK]] 2023-02-07 15:03:07,712 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:07,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e5e1a382a5128222ac9c9beaffd3a7ff, NAME => 'hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:07,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:07,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:07,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:07,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:07,718 INFO [StoreOpener-e5e1a382a5128222ac9c9beaffd3a7ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:07,720 DEBUG [StoreOpener-e5e1a382a5128222ac9c9beaffd3a7ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/info 2023-02-07 15:03:07,720 DEBUG [StoreOpener-e5e1a382a5128222ac9c9beaffd3a7ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/info 2023-02-07 15:03:07,720 INFO [StoreOpener-e5e1a382a5128222ac9c9beaffd3a7ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5e1a382a5128222ac9c9beaffd3a7ff columnFamilyName info 2023-02-07 15:03:07,721 INFO [StoreOpener-e5e1a382a5128222ac9c9beaffd3a7ff-1] regionserver.HStore(310): Store=e5e1a382a5128222ac9c9beaffd3a7ff/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:07,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:07,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:07,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:07,729 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:07,730 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e5e1a382a5128222ac9c9beaffd3a7ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63975341, jitterRate=-0.04669313132762909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:07,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e5e1a382a5128222ac9c9beaffd3a7ff: Running coprocessor pre-open hook at 1675782187713Writing region info on filesystem at 1675782187713Initializing all the Stores at 1675782187714 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782187714Cleaning up temporary data from old regions at 1675782187723 (+9 ms)Cleaning up detritus from prior splits at 1675782187723Running coprocessor post-open hooks at 1675782187730 (+7 ms)Region opened successfully at 1675782187730 2023-02-07 15:03:07,731 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff., pid=6, masterSystemTime=1675782187684 2023-02-07 15:03:07,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:07,734 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:07,734 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e5e1a382a5128222ac9c9beaffd3a7ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:07,735 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782187734"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782187734"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782187734"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782187734"}]},"ts":"1675782187734"} 2023-02-07 15:03:07,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 15:03:07,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e5e1a382a5128222ac9c9beaffd3a7ff, server=jenkins-hbase4.apache.org,35599,1675782186183 in 221 msec 2023-02-07 15:03:07,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 15:03:07,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e5e1a382a5128222ac9c9beaffd3a7ff, ASSIGN in 382 msec 2023-02-07 15:03:07,741 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:07,741 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782187741"}]},"ts":"1675782187741"} 2023-02-07 15:03:07,743 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 15:03:07,745 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:07,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 833 msec 2023-02-07 15:03:07,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 15:03:07,817 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:07,818 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:07,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 15:03:07,832 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:07,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-07 15:03:07,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 15:03:07,854 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:07,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-07 15:03:07,870 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 15:03:07,876 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 15:03:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.623sec 2023-02-07 15:03:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 15:03:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 15:03:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 15:03:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1675782186118-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 15:03:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1675782186118-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 15:03:07,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 15:03:07,948 DEBUG [Listener at localhost/45505] zookeeper.ReadOnlyZKClient(139): Connect 0x4d3db339 to 127.0.0.1:58177 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:07,954 DEBUG [Listener at localhost/45505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6caafbef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:07,955 DEBUG [hconnection-0x35752731-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:07,958 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:07,959 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:07,960 DEBUG [Listener at localhost/45505] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 15:03:07,960 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:07,960 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:07,962 DEBUG [Listener at localhost/45505] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 15:03:07,964 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58458, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 15:03:07,965 INFO [Listener at localhost/45505] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 15:03:07,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 15:03:07,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 15:03:07,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:58458 deadline: 1675782247965, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 15:03:07,966 INFO [Listener at localhost/45505] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 15:03:07,966 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:07,966 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:07,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:07,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 15:03:07,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:07,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 15:03:07,973 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:07,973 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:07,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:07,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:07,984 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:07,985 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1 empty. 2023-02-07 15:03:07,985 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a empty. 2023-02-07 15:03:07,985 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360 empty. 2023-02-07 15:03:07,985 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7 empty. 2023-02-07 15:03:07,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:07,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:07,986 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:07,986 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:07,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1 empty. 2023-02-07 15:03:07,987 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639 empty. 2023-02-07 15:03:07,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef empty. 2023-02-07 15:03:07,987 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62 empty. 2023-02-07 15:03:07,987 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b empty. 2023-02-07 15:03:07,987 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:07,987 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf empty. 2023-02-07 15:03:07,987 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:07,988 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:07,988 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:07,988 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:07,988 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:07,988 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:07,988 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:07,988 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 15:03:08,003 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:08,004 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8c0e0fe141e2d74cb3e983941db863a1, NAME => 'testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,005 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => dbde7afb9ea91e7cd5e8b278733dbe5a, NAME => 'testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,005 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 77764c0223c4c5a67e1df0e8dc611ac7, NAME => 'testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 77764c0223c4c5a67e1df0e8dc611ac7, disabling compactions & flushes 2023-02-07 15:03:08,024 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:08,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:08,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. after waiting 0 ms 2023-02-07 15:03:08,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:08,024 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:08,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 77764c0223c4c5a67e1df0e8dc611ac7: Waiting for close lock at 1675782188024Disabling compacts and flushes for region at 1675782188024Disabling writes for close at 1675782188024Writing region close event to WAL at 1675782188024Closed at 1675782188024 2023-02-07 15:03:08,025 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5809147126b1d00a96d9149aede55c62, NAME => 'testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 8c0e0fe141e2d74cb3e983941db863a1, disabling compactions & flushes 2023-02-07 15:03:08,027 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:08,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:08,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. after waiting 0 ms 2023-02-07 15:03:08,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:08,027 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:08,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 8c0e0fe141e2d74cb3e983941db863a1: Waiting for close lock at 1675782188027Disabling compacts and flushes for region at 1675782188027Disabling writes for close at 1675782188027Writing region close event to WAL at 1675782188027Closed at 1675782188027 2023-02-07 15:03:08,028 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d7d946692158ddfbfd3bb655e3c71360, NAME => 'testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,040 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,040 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing dbde7afb9ea91e7cd5e8b278733dbe5a, disabling compactions & flushes 2023-02-07 15:03:08,040 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:08,040 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:08,040 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. after waiting 0 ms 2023-02-07 15:03:08,040 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:08,040 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:08,040 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for dbde7afb9ea91e7cd5e8b278733dbe5a: Waiting for close lock at 1675782188040Disabling compacts and flushes for region at 1675782188040Disabling writes for close at 1675782188040Writing region close event to WAL at 1675782188040Closed at 1675782188040 2023-02-07 15:03:08,041 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4515ba2af0acbc3524e578aa3b6e31f1, NAME => 'testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 5809147126b1d00a96d9149aede55c62, disabling compactions & flushes 2023-02-07 15:03:08,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:08,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:08,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. after waiting 0 ms 2023-02-07 15:03:08,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:08,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:08,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 5809147126b1d00a96d9149aede55c62: Waiting for close lock at 1675782188045Disabling compacts and flushes for region at 1675782188045Disabling writes for close at 1675782188045Writing region close event to WAL at 1675782188045Closed at 1675782188045 2023-02-07 15:03:08,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e1642859e19b6de8bf9bffe58462f20b, NAME => 'testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d7d946692158ddfbfd3bb655e3c71360, disabling compactions & flushes 2023-02-07 15:03:08,047 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:08,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:08,048 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. after waiting 0 ms 2023-02-07 15:03:08,048 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:08,048 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:08,048 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d7d946692158ddfbfd3bb655e3c71360: Waiting for close lock at 1675782188047Disabling compacts and flushes for region at 1675782188047Disabling writes for close at 1675782188048 (+1 ms)Writing region close event to WAL at 1675782188048Closed at 1675782188048 2023-02-07 15:03:08,048 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => bfb63f50c3843ca8196811d685109aef, NAME => 'testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4515ba2af0acbc3524e578aa3b6e31f1, disabling compactions & flushes 2023-02-07 15:03:08,051 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:08,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:08,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. after waiting 0 ms 2023-02-07 15:03:08,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:08,051 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:08,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4515ba2af0acbc3524e578aa3b6e31f1: Waiting for close lock at 1675782188051Disabling compacts and flushes for region at 1675782188051Disabling writes for close at 1675782188051Writing region close event to WAL at 1675782188051Closed at 1675782188051 2023-02-07 15:03:08,052 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 79871bca5cdc3f41385c7b09cd0f3639, NAME => 'testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e1642859e19b6de8bf9bffe58462f20b, disabling compactions & flushes 2023-02-07 15:03:08,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:08,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:08,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. after waiting 0 ms 2023-02-07 15:03:08,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:08,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:08,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e1642859e19b6de8bf9bffe58462f20b: Waiting for close lock at 1675782188068Disabling compacts and flushes for region at 1675782188068Disabling writes for close at 1675782188069 (+1 ms)Writing region close event to WAL at 1675782188069Closed at 1675782188069 2023-02-07 15:03:08,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b90841eb824d768a9bd46941e96b95bf, NAME => 'testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.tmp 2023-02-07 15:03:08,075 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:08,075 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:08,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:08,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing bfb63f50c3843ca8196811d685109aef, disabling compactions & flushes 2023-02-07 15:03:08,091 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:08,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:08,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. after waiting 0 ms 2023-02-07 15:03:08,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:08,091 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:08,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for bfb63f50c3843ca8196811d685109aef: Waiting for close lock at 1675782188091Disabling compacts and flushes for region at 1675782188091Disabling writes for close at 1675782188091Writing region close event to WAL at 1675782188091Closed at 1675782188091 2023-02-07 15:03:08,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 79871bca5cdc3f41385c7b09cd0f3639, disabling compactions & flushes 2023-02-07 15:03:08,101 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:08,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:08,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. after waiting 0 ms 2023-02-07 15:03:08,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:08,101 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:08,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 79871bca5cdc3f41385c7b09cd0f3639: Waiting for close lock at 1675782188101Disabling compacts and flushes for region at 1675782188101Disabling writes for close at 1675782188101Writing region close event to WAL at 1675782188101Closed at 1675782188101 2023-02-07 15:03:08,103 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,103 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b90841eb824d768a9bd46941e96b95bf, disabling compactions & flushes 2023-02-07 15:03:08,103 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:08,103 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:08,103 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. after waiting 0 ms 2023-02-07 15:03:08,103 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:08,103 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:08,103 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b90841eb824d768a9bd46941e96b95bf: Waiting for close lock at 1675782188103Disabling compacts and flushes for region at 1675782188103Disabling writes for close at 1675782188103Writing region close event to WAL at 1675782188103Closed at 1675782188103 2023-02-07 15:03:08,106 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782188107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782188107"}]},"ts":"1675782188107"} 2023-02-07 15:03:08,114 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 15:03:08,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:08,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782188115"}]},"ts":"1675782188115"} 2023-02-07 15:03:08,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 15:03:08,121 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:08,130 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:08,130 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:08,130 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:08,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8c0e0fe141e2d74cb3e983941db863a1, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dbde7afb9ea91e7cd5e8b278733dbe5a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77764c0223c4c5a67e1df0e8dc611ac7, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5809147126b1d00a96d9149aede55c62, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d7d946692158ddfbfd3bb655e3c71360, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4515ba2af0acbc3524e578aa3b6e31f1, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1642859e19b6de8bf9bffe58462f20b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bfb63f50c3843ca8196811d685109aef, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=79871bca5cdc3f41385c7b09cd0f3639, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b90841eb824d768a9bd46941e96b95bf, ASSIGN}] 2023-02-07 15:03:08,133 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=79871bca5cdc3f41385c7b09cd0f3639, ASSIGN 2023-02-07 15:03:08,134 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dbde7afb9ea91e7cd5e8b278733dbe5a, ASSIGN 2023-02-07 15:03:08,134 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8c0e0fe141e2d74cb3e983941db863a1, ASSIGN 2023-02-07 15:03:08,134 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b90841eb824d768a9bd46941e96b95bf, ASSIGN 2023-02-07 15:03:08,135 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8c0e0fe141e2d74cb3e983941db863a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35599,1675782186183; forceNewPlan=false, retain=false 2023-02-07 15:03:08,135 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=79871bca5cdc3f41385c7b09cd0f3639, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40983,1675782186221; forceNewPlan=false, retain=false 2023-02-07 15:03:08,135 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dbde7afb9ea91e7cd5e8b278733dbe5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40983,1675782186221; forceNewPlan=false, retain=false 2023-02-07 15:03:08,135 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b90841eb824d768a9bd46941e96b95bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35599,1675782186183; forceNewPlan=false, retain=false 2023-02-07 15:03:08,135 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bfb63f50c3843ca8196811d685109aef, ASSIGN 2023-02-07 15:03:08,137 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1642859e19b6de8bf9bffe58462f20b, ASSIGN 2023-02-07 15:03:08,137 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d7d946692158ddfbfd3bb655e3c71360, ASSIGN 2023-02-07 15:03:08,137 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bfb63f50c3843ca8196811d685109aef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35599,1675782186183; forceNewPlan=false, retain=false 2023-02-07 15:03:08,137 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4515ba2af0acbc3524e578aa3b6e31f1, ASSIGN 2023-02-07 15:03:08,137 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5809147126b1d00a96d9149aede55c62, ASSIGN 2023-02-07 15:03:08,138 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e1642859e19b6de8bf9bffe58462f20b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40983,1675782186221; forceNewPlan=false, retain=false 2023-02-07 15:03:08,138 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d7d946692158ddfbfd3bb655e3c71360, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40983,1675782186221; forceNewPlan=false, retain=false 2023-02-07 15:03:08,138 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4515ba2af0acbc3524e578aa3b6e31f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35599,1675782186183; forceNewPlan=false, retain=false 2023-02-07 15:03:08,138 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77764c0223c4c5a67e1df0e8dc611ac7, ASSIGN 2023-02-07 15:03:08,138 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5809147126b1d00a96d9149aede55c62, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35599,1675782186183; forceNewPlan=false, retain=false 2023-02-07 15:03:08,139 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=77764c0223c4c5a67e1df0e8dc611ac7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40983,1675782186221; forceNewPlan=false, retain=false 2023-02-07 15:03:08,277 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:08,277 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:08,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:08,285 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 15:03:08,290 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=79871bca5cdc3f41385c7b09cd0f3639, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,290 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=77764c0223c4c5a67e1df0e8dc611ac7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,290 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188290"}]},"ts":"1675782188290"} 2023-02-07 15:03:08,290 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188290"}]},"ts":"1675782188290"} 2023-02-07 15:03:08,290 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e1642859e19b6de8bf9bffe58462f20b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,291 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188290"}]},"ts":"1675782188290"} 2023-02-07 15:03:08,290 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dbde7afb9ea91e7cd5e8b278733dbe5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,292 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188290"}]},"ts":"1675782188290"} 2023-02-07 15:03:08,290 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d7d946692158ddfbfd3bb655e3c71360, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,293 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188290"}]},"ts":"1675782188290"} 2023-02-07 15:03:08,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 79871bca5cdc3f41385c7b09cd0f3639, server=jenkins-hbase4.apache.org,40983,1675782186221}] 2023-02-07 15:03:08,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 77764c0223c4c5a67e1df0e8dc611ac7, server=jenkins-hbase4.apache.org,40983,1675782186221}] 2023-02-07 15:03:08,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure e1642859e19b6de8bf9bffe58462f20b, server=jenkins-hbase4.apache.org,40983,1675782186221}] 2023-02-07 15:03:08,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure dbde7afb9ea91e7cd5e8b278733dbe5a, server=jenkins-hbase4.apache.org,40983,1675782186221}] 2023-02-07 15:03:08,304 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=bfb63f50c3843ca8196811d685109aef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,305 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188304"}]},"ts":"1675782188304"} 2023-02-07 15:03:08,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure d7d946692158ddfbfd3bb655e3c71360, server=jenkins-hbase4.apache.org,40983,1675782186221}] 2023-02-07 15:03:08,306 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5809147126b1d00a96d9149aede55c62, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,307 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188306"}]},"ts":"1675782188306"} 2023-02-07 15:03:08,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure bfb63f50c3843ca8196811d685109aef, server=jenkins-hbase4.apache.org,35599,1675782186183}] 2023-02-07 15:03:08,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 5809147126b1d00a96d9149aede55c62, server=jenkins-hbase4.apache.org,35599,1675782186183}] 2023-02-07 15:03:08,310 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b90841eb824d768a9bd46941e96b95bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,311 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782188310"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188310"}]},"ts":"1675782188310"} 2023-02-07 15:03:08,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4515ba2af0acbc3524e578aa3b6e31f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,312 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188312"}]},"ts":"1675782188312"} 2023-02-07 15:03:08,312 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8c0e0fe141e2d74cb3e983941db863a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,313 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782188312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782188312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782188312"}]},"ts":"1675782188312"} 2023-02-07 15:03:08,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure b90841eb824d768a9bd46941e96b95bf, server=jenkins-hbase4.apache.org,35599,1675782186183}] 2023-02-07 15:03:08,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure 4515ba2af0acbc3524e578aa3b6e31f1, server=jenkins-hbase4.apache.org,35599,1675782186183}] 2023-02-07 15:03:08,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 8c0e0fe141e2d74cb3e983941db863a1, server=jenkins-hbase4.apache.org,35599,1675782186183}] 2023-02-07 15:03:08,448 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,448 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:08,451 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51208, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:08,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:08,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 79871bca5cdc3f41385c7b09cd0f3639, NAME => 'testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 15:03:08,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,458 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,459 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1 2023-02-07 15:03:08,459 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1 2023-02-07 15:03:08,459 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79871bca5cdc3f41385c7b09cd0f3639 columnFamilyName f1 2023-02-07 15:03:08,460 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(310): Store=79871bca5cdc3f41385c7b09cd0f3639/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,460 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,461 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2 2023-02-07 15:03:08,461 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2 2023-02-07 15:03:08,462 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79871bca5cdc3f41385c7b09cd0f3639 columnFamilyName f2 2023-02-07 15:03:08,462 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(310): Store=79871bca5cdc3f41385c7b09cd0f3639/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:08,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:08,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8c0e0fe141e2d74cb3e983941db863a1, NAME => 'testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 15:03:08,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,469 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 79871bca5cdc3f41385c7b09cd0f3639; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75007491, jitterRate=0.11769871413707733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 79871bca5cdc3f41385c7b09cd0f3639: Running coprocessor pre-open hook at 1675782188457Writing region info on filesystem at 1675782188457Initializing all the Stores at 1675782188457Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188457Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188458 (+1 ms)Cleaning up temporary data from old regions at 1675782188464 (+6 ms)Cleaning up detritus from prior splits at 1675782188464Running coprocessor post-open hooks at 1675782188469 (+5 ms)Region opened successfully at 1675782188469 2023-02-07 15:03:08,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639., pid=21, masterSystemTime=1675782188447 2023-02-07 15:03:08,472 DEBUG [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/f1 2023-02-07 15:03:08,472 DEBUG [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/f1 2023-02-07 15:03:08,473 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0e0fe141e2d74cb3e983941db863a1 columnFamilyName f1 2023-02-07 15:03:08,473 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(310): Store=8c0e0fe141e2d74cb3e983941db863a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:08,474 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:08,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:08,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d7d946692158ddfbfd3bb655e3c71360, NAME => 'testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 15:03:08,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=79871bca5cdc3f41385c7b09cd0f3639, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,475 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188475"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188475"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188475"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188475"}]},"ts":"1675782188475"} 2023-02-07 15:03:08,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,476 DEBUG [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/f2 2023-02-07 15:03:08,476 DEBUG [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/f2 2023-02-07 15:03:08,477 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0e0fe141e2d74cb3e983941db863a1 columnFamilyName f2 2023-02-07 15:03:08,477 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(310): Store=8c0e0fe141e2d74cb3e983941db863a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,478 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-07 15:03:08,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 79871bca5cdc3f41385c7b09cd0f3639, server=jenkins-hbase4.apache.org,40983,1675782186221 in 183 msec 2023-02-07 15:03:08,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,480 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1 2023-02-07 15:03:08,480 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1 2023-02-07 15:03:08,480 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7d946692158ddfbfd3bb655e3c71360 columnFamilyName f1 2023-02-07 15:03:08,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=79871bca5cdc3f41385c7b09cd0f3639, ASSIGN in 348 msec 2023-02-07 15:03:08,481 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(310): Store=d7d946692158ddfbfd3bb655e3c71360/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,481 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,484 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2 2023-02-07 15:03:08,484 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2 2023-02-07 15:03:08,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:08,484 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7d946692158ddfbfd3bb655e3c71360 columnFamilyName f2 2023-02-07 15:03:08,485 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(310): Store=d7d946692158ddfbfd3bb655e3c71360/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8c0e0fe141e2d74cb3e983941db863a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71993738, jitterRate=0.07279029488563538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8c0e0fe141e2d74cb3e983941db863a1: Running coprocessor pre-open hook at 1675782188467Writing region info on filesystem at 1675782188467Initializing all the Stores at 1675782188468 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188469 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188469Cleaning up temporary data from old regions at 1675782188481 (+12 ms)Cleaning up detritus from prior splits at 1675782188481Running coprocessor post-open hooks at 1675782188487 (+6 ms)Region opened successfully at 1675782188487 2023-02-07 15:03:08,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1., pid=30, masterSystemTime=1675782188464 2023-02-07 15:03:08,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:08,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:08,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:08,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5809147126b1d00a96d9149aede55c62, NAME => 'testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 15:03:08,490 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8c0e0fe141e2d74cb3e983941db863a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:08,490 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782188490"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188490"}]},"ts":"1675782188490"} 2023-02-07 15:03:08,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,493 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,494 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1 2023-02-07 15:03:08,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d7d946692158ddfbfd3bb655e3c71360; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59862517, jitterRate=-0.10797898471355438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,494 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1 2023-02-07 15:03:08,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d7d946692158ddfbfd3bb655e3c71360: Running coprocessor pre-open hook at 1675782188476Writing region info on filesystem at 1675782188476Initializing all the Stores at 1675782188477 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188477Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188478 (+1 ms)Cleaning up temporary data from old regions at 1675782188487 (+9 ms)Cleaning up detritus from prior splits at 1675782188487Running coprocessor post-open hooks at 1675782188494 (+7 ms)Region opened successfully at 1675782188494 2023-02-07 15:03:08,495 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5809147126b1d00a96d9149aede55c62 columnFamilyName f1 2023-02-07 15:03:08,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-07 15:03:08,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 8c0e0fe141e2d74cb3e983941db863a1, server=jenkins-hbase4.apache.org,35599,1675782186183 in 176 msec 2023-02-07 15:03:08,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360., pid=25, masterSystemTime=1675782188447 2023-02-07 15:03:08,495 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(310): Store=5809147126b1d00a96d9149aede55c62/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,496 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8c0e0fe141e2d74cb3e983941db863a1, ASSIGN in 364 msec 2023-02-07 15:03:08,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:08,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:08,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:08,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dbde7afb9ea91e7cd5e8b278733dbe5a, NAME => 'testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 15:03:08,498 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d7d946692158ddfbfd3bb655e3c71360, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,498 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188497"}]},"ts":"1675782188497"} 2023-02-07 15:03:08,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,499 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2 2023-02-07 15:03:08,499 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2 2023-02-07 15:03:08,499 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5809147126b1d00a96d9149aede55c62 columnFamilyName f2 2023-02-07 15:03:08,499 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,500 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(310): Store=5809147126b1d00a96d9149aede55c62/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,501 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1 2023-02-07 15:03:08,501 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1 2023-02-07 15:03:08,502 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbde7afb9ea91e7cd5e8b278733dbe5a columnFamilyName f1 2023-02-07 15:03:08,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-07 15:03:08,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure d7d946692158ddfbfd3bb655e3c71360, server=jenkins-hbase4.apache.org,40983,1675782186221 in 195 msec 2023-02-07 15:03:08,502 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(310): Store=dbde7afb9ea91e7cd5e8b278733dbe5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,502 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d7d946692158ddfbfd3bb655e3c71360, ASSIGN in 371 msec 2023-02-07 15:03:08,504 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2 2023-02-07 15:03:08,504 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2 2023-02-07 15:03:08,504 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbde7afb9ea91e7cd5e8b278733dbe5a columnFamilyName f2 2023-02-07 15:03:08,504 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(310): Store=dbde7afb9ea91e7cd5e8b278733dbe5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:08,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:08,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dbde7afb9ea91e7cd5e8b278733dbe5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73102728, jitterRate=0.08931553363800049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dbde7afb9ea91e7cd5e8b278733dbe5a: Running coprocessor pre-open hook at 1675782188498Writing region info on filesystem at 1675782188498Initializing all the Stores at 1675782188499 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188499Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188499Cleaning up temporary data from old regions at 1675782188506 (+7 ms)Cleaning up detritus from prior splits at 1675782188507 (+1 ms)Running coprocessor post-open hooks at 1675782188524 (+17 ms)Region opened successfully at 1675782188524 2023-02-07 15:03:08,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5809147126b1d00a96d9149aede55c62; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59010391, jitterRate=-0.12067665159702301}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5809147126b1d00a96d9149aede55c62: Running coprocessor pre-open hook at 1675782188491Writing region info on filesystem at 1675782188491Initializing all the Stores at 1675782188492 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188492Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188492Cleaning up temporary data from old regions at 1675782188503 (+11 ms)Cleaning up detritus from prior splits at 1675782188503Running coprocessor post-open hooks at 1675782188525 (+22 ms)Region opened successfully at 1675782188525 2023-02-07 15:03:08,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a., pid=24, masterSystemTime=1675782188447 2023-02-07 15:03:08,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62., pid=27, masterSystemTime=1675782188464 2023-02-07 15:03:08,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:08,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:08,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:08,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77764c0223c4c5a67e1df0e8dc611ac7, NAME => 'testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 15:03:08,528 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dbde7afb9ea91e7cd5e8b278733dbe5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,528 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188528"}]},"ts":"1675782188528"} 2023-02-07 15:03:08,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:08,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:08,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:08,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4515ba2af0acbc3524e578aa3b6e31f1, NAME => 'testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 15:03:08,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,530 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5809147126b1d00a96d9149aede55c62, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,530 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188529"}]},"ts":"1675782188529"} 2023-02-07 15:03:08,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-07 15:03:08,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure dbde7afb9ea91e7cd5e8b278733dbe5a, server=jenkins-hbase4.apache.org,40983,1675782186221 in 232 msec 2023-02-07 15:03:08,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-07 15:03:08,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 5809147126b1d00a96d9149aede55c62, server=jenkins-hbase4.apache.org,35599,1675782186183 in 222 msec 2023-02-07 15:03:08,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dbde7afb9ea91e7cd5e8b278733dbe5a, ASSIGN in 403 msec 2023-02-07 15:03:08,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5809147126b1d00a96d9149aede55c62, ASSIGN in 404 msec 2023-02-07 15:03:08,540 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,544 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,545 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1 2023-02-07 15:03:08,545 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1 2023-02-07 15:03:08,545 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1 2023-02-07 15:03:08,546 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1 2023-02-07 15:03:08,546 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77764c0223c4c5a67e1df0e8dc611ac7 columnFamilyName f1 2023-02-07 15:03:08,546 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4515ba2af0acbc3524e578aa3b6e31f1 columnFamilyName f1 2023-02-07 15:03:08,547 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(310): Store=4515ba2af0acbc3524e578aa3b6e31f1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,547 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,547 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(310): Store=77764c0223c4c5a67e1df0e8dc611ac7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,547 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,548 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2 2023-02-07 15:03:08,548 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2 2023-02-07 15:03:08,549 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2 2023-02-07 15:03:08,549 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2 2023-02-07 15:03:08,549 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4515ba2af0acbc3524e578aa3b6e31f1 columnFamilyName f2 2023-02-07 15:03:08,549 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(310): Store=4515ba2af0acbc3524e578aa3b6e31f1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,552 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77764c0223c4c5a67e1df0e8dc611ac7 columnFamilyName f2 2023-02-07 15:03:08,552 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(310): Store=77764c0223c4c5a67e1df0e8dc611ac7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:08,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:08,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4515ba2af0acbc3524e578aa3b6e31f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66265864, jitterRate=-0.012561678886413574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4515ba2af0acbc3524e578aa3b6e31f1: Running coprocessor pre-open hook at 1675782188530Writing region info on filesystem at 1675782188530Initializing all the Stores at 1675782188532 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188532Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188544 (+12 ms)Cleaning up temporary data from old regions at 1675782188552 (+8 ms)Cleaning up detritus from prior splits at 1675782188553 (+1 ms)Running coprocessor post-open hooks at 1675782188559 (+6 ms)Region opened successfully at 1675782188559 2023-02-07 15:03:08,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1., pid=29, masterSystemTime=1675782188464 2023-02-07 15:03:08,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 77764c0223c4c5a67e1df0e8dc611ac7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63000864, jitterRate=-0.06121397018432617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:08,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 77764c0223c4c5a67e1df0e8dc611ac7: Running coprocessor pre-open hook at 1675782188529Writing region info on filesystem at 1675782188529Initializing all the Stores at 1675782188531 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188531Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188540 (+9 ms)Cleaning up temporary data from old regions at 1675782188554 (+14 ms)Cleaning up detritus from prior splits at 1675782188555 (+1 ms)Running coprocessor post-open hooks at 1675782188561 (+6 ms)Region opened successfully at 1675782188561 2023-02-07 15:03:08,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:08,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:08,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b90841eb824d768a9bd46941e96b95bf, NAME => 'testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 15:03:08,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4515ba2af0acbc3524e578aa3b6e31f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7., pid=22, masterSystemTime=1675782188447 2023-02-07 15:03:08,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188562"}]},"ts":"1675782188562"} 2023-02-07 15:03:08,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:08,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:08,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:08,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e1642859e19b6de8bf9bffe58462f20b, NAME => 'testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 15:03:08,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,566 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=77764c0223c4c5a67e1df0e8dc611ac7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188566"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188566"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188566"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188566"}]},"ts":"1675782188566"} 2023-02-07 15:03:08,567 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,568 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-07 15:03:08,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure 4515ba2af0acbc3524e578aa3b6e31f1, server=jenkins-hbase4.apache.org,35599,1675782186183 in 248 msec 2023-02-07 15:03:08,569 DEBUG [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/f1 2023-02-07 15:03:08,570 DEBUG [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/f1 2023-02-07 15:03:08,570 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90841eb824d768a9bd46941e96b95bf columnFamilyName f1 2023-02-07 15:03:08,570 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1 2023-02-07 15:03:08,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4515ba2af0acbc3524e578aa3b6e31f1, ASSIGN in 437 msec 2023-02-07 15:03:08,570 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1 2023-02-07 15:03:08,571 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(310): Store=b90841eb824d768a9bd46941e96b95bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,571 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,571 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1642859e19b6de8bf9bffe58462f20b columnFamilyName f1 2023-02-07 15:03:08,572 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(310): Store=e1642859e19b6de8bf9bffe58462f20b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-07 15:03:08,572 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 77764c0223c4c5a67e1df0e8dc611ac7, server=jenkins-hbase4.apache.org,40983,1675782186221 in 274 msec 2023-02-07 15:03:08,573 DEBUG [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/f2 2023-02-07 15:03:08,573 DEBUG [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/f2 2023-02-07 15:03:08,573 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90841eb824d768a9bd46941e96b95bf columnFamilyName f2 2023-02-07 15:03:08,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77764c0223c4c5a67e1df0e8dc611ac7, ASSIGN in 441 msec 2023-02-07 15:03:08,574 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(310): Store=b90841eb824d768a9bd46941e96b95bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,574 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2 2023-02-07 15:03:08,574 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2 2023-02-07 15:03:08,575 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1642859e19b6de8bf9bffe58462f20b columnFamilyName f2 2023-02-07 15:03:08,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,576 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(310): Store=e1642859e19b6de8bf9bffe58462f20b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,579 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:08,579 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:08,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:08,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:08,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:08,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b90841eb824d768a9bd46941e96b95bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59410167, jitterRate=-0.11471952497959137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b90841eb824d768a9bd46941e96b95bf: Running coprocessor pre-open hook at 1675782188564Writing region info on filesystem at 1675782188564Initializing all the Stores at 1675782188565 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188565Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188567 (+2 ms)Cleaning up temporary data from old regions at 1675782188586 (+19 ms)Cleaning up detritus from prior splits at 1675782188586Running coprocessor post-open hooks at 1675782188592 (+6 ms)Region opened successfully at 1675782188592 2023-02-07 15:03:08,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e1642859e19b6de8bf9bffe58462f20b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64037353, jitterRate=-0.04576908051967621}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e1642859e19b6de8bf9bffe58462f20b: Running coprocessor pre-open hook at 1675782188565Writing region info on filesystem at 1675782188565Initializing all the Stores at 1675782188566 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188566Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188568 (+2 ms)Cleaning up temporary data from old regions at 1675782188586 (+18 ms)Cleaning up detritus from prior splits at 1675782188587 (+1 ms)Running coprocessor post-open hooks at 1675782188592 (+5 ms)Region opened successfully at 1675782188592 2023-02-07 15:03:08,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf., pid=28, masterSystemTime=1675782188464 2023-02-07 15:03:08,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b., pid=23, masterSystemTime=1675782188447 2023-02-07 15:03:08,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:08,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:08,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:08,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bfb63f50c3843ca8196811d685109aef, NAME => 'testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 15:03:08,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b90841eb824d768a9bd46941e96b95bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,596 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675782188595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188595"}]},"ts":"1675782188595"} 2023-02-07 15:03:08,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:08,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:08,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:08,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,596 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e1642859e19b6de8bf9bffe58462f20b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:08,597 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188596"}]},"ts":"1675782188596"} 2023-02-07 15:03:08,599 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,601 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1 2023-02-07 15:03:08,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-07 15:03:08,601 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1 2023-02-07 15:03:08,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure b90841eb824d768a9bd46941e96b95bf, server=jenkins-hbase4.apache.org,35599,1675782186183 in 284 msec 2023-02-07 15:03:08,602 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfb63f50c3843ca8196811d685109aef columnFamilyName f1 2023-02-07 15:03:08,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-07 15:03:08,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure e1642859e19b6de8bf9bffe58462f20b, server=jenkins-hbase4.apache.org,40983,1675782186221 in 302 msec 2023-02-07 15:03:08,602 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(310): Store=bfb63f50c3843ca8196811d685109aef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,602 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b90841eb824d768a9bd46941e96b95bf, ASSIGN in 470 msec 2023-02-07 15:03:08,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e1642859e19b6de8bf9bffe58462f20b, ASSIGN in 471 msec 2023-02-07 15:03:08,604 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2 2023-02-07 15:03:08,604 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2 2023-02-07 15:03:08,604 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfb63f50c3843ca8196811d685109aef columnFamilyName f2 2023-02-07 15:03:08,605 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(310): Store=bfb63f50c3843ca8196811d685109aef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:08,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:08,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:08,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:08,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bfb63f50c3843ca8196811d685109aef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71775384, jitterRate=0.06953656673431396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:08,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bfb63f50c3843ca8196811d685109aef: Running coprocessor pre-open hook at 1675782188596Writing region info on filesystem at 1675782188596Initializing all the Stores at 1675782188598 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188598Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782188599 (+1 ms)Cleaning up temporary data from old regions at 1675782188607 (+8 ms)Cleaning up detritus from prior splits at 1675782188607Running coprocessor post-open hooks at 1675782188612 (+5 ms)Region opened successfully at 1675782188612 2023-02-07 15:03:08,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef., pid=26, masterSystemTime=1675782188464 2023-02-07 15:03:08,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:08,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:08,614 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=bfb63f50c3843ca8196811d685109aef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:08,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675782188614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782188614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782188614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782188614"}]},"ts":"1675782188614"} 2023-02-07 15:03:08,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-07 15:03:08,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure bfb63f50c3843ca8196811d685109aef, server=jenkins-hbase4.apache.org,35599,1675782186183 in 309 msec 2023-02-07 15:03:08,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-07 15:03:08,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bfb63f50c3843ca8196811d685109aef, ASSIGN in 486 msec 2023-02-07 15:03:08,620 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:08,620 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782188620"}]},"ts":"1675782188620"} 2023-02-07 15:03:08,621 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 15:03:08,623 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:08,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 655 msec 2023-02-07 15:03:09,087 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 15:03:09,087 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:09,087 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:09,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:09,089 INFO [Listener at localhost/45505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 15:03:09,090 DEBUG [Listener at localhost/45505] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 15:03:09,090 INFO [Listener at localhost/45505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:09,106 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 15:03:09,106 INFO [Listener at localhost/45505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:09,107 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 15:03:09,107 INFO [Listener at localhost/45505] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 15:03:09,186 DEBUG [hconnection-0x35752731-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:09,205 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:09,210 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35599] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:09,221 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40983] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:09,366 INFO [Listener at localhost/45505] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 15:03:09,366 INFO [Listener at localhost/45505] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 15:03:09,366 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:09,367 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:09,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:03:09,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675782189368 (current time:1675782189368). 2023-02-07 15:03:09,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 15:03:09,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x609074c7 to 127.0.0.1:58177 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:09,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8ffe5bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:09,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:09,381 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55846, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:09,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x609074c7 to 127.0.0.1:58177 2023-02-07 15:03:09,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:09,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 15:03:09,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:03:09,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:03:09,386 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:03:09,387 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675782789387 2023-02-07 15:03:09,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:03:09,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 15:03:09,388 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:09,389 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 15:03:09,389 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:03:09,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:03:09,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-07 15:03:09,391 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:03:09,392 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675782789392 2023-02-07 15:03:09,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,411 INFO [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-07 15:03:09,412 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:09,413 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-07 15:03:09,413 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-07 15:03:09,485 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,485 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,487 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:09,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:09,487 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:09,487 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:09,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,488 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:09,488 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:09,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,488 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:09,488 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-07 15:03:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 15:03:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-07 15:03:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 15:03:09,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,489 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-07 15:03:09,489 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:09,490 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-07 15:03:09,490 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:09,490 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:09,489 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:09,491 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:09,490 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-07 15:03:09,491 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-07 15:03:09,491 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-07 15:03:09,491 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-07 15:03:09,492 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40983,1675782186221' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-07 15:03:09,492 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35599,1675782186183' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-07 15:03:09,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:03:09,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:09,493 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 15:03:09,493 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,493 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,493 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:09,494 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:09,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:09,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:09,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:09,494 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,494 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:09,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:09,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:09,494 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,495 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:09,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:09,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35599,1675782186183' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-07 15:03:09,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69928d2c[Count = 1] remaining members to acquire global barrier 2023-02-07 15:03:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:09,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:09,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:09,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40983,1675782186221' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-07 15:03:09,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69928d2c[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:09,502 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-07 15:03:09,502 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,504 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,504 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-07 15:03:09,504 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:09,504 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:09,505 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:09,505 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. started... 2023-02-07 15:03:09,505 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. started... 2023-02-07 15:03:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 15:03:09,508 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:09,508 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-07 15:03:09,508 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:09,505 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:09,509 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:09,509 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5809147126b1d00a96d9149aede55c62 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:09,509 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bfb63f50c3843ca8196811d685109aef 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:09,509 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. started... 2023-02-07 15:03:09,509 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:09,510 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. started... 2023-02-07 15:03:09,517 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8c0e0fe141e2d74cb3e983941db863a1: 2023-02-07 15:03:09,517 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:09,517 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d7d946692158ddfbfd3bb655e3c71360 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:09,517 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,517 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. started... 2023-02-07 15:03:09,517 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,517 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:09,517 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 15:03:09,521 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 77764c0223c4c5a67e1df0e8dc611ac7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:09,521 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:09,521 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. started... 2023-02-07 15:03:09,521 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:09,522 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e1642859e19b6de8bf9bffe58462f20b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:09,648 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. completed. 2023-02-07 15:03:09,649 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:09,649 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:09,649 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 15:03:09,649 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. started... 2023-02-07 15:03:09,652 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f1/43d60b74144a46669fcf31fe2535e797 2023-02-07 15:03:09,652 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f1/6217c9590c1a47c79535b1697f4c8fdb 2023-02-07 15:03:09,653 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f1/2fcc930802de481c871e2a0e442a6976 2023-02-07 15:03:09,657 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4515ba2af0acbc3524e578aa3b6e31f1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:09,664 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f1/a0ddf5c025544ceb9335c447888d7f6b 2023-02-07 15:03:09,675 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f1/39603cce918d4b9bb5371ca08cb70f2b 2023-02-07 15:03:09,693 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:09,694 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:09,694 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:09,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:03:09,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:09,696 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 15:03:09,724 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f2/d7ca5be343c54fbb9ced96346fab7330 2023-02-07 15:03:09,724 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f1/29e132e4d7754c259e0b7b7b2fb2851d 2023-02-07 15:03:09,761 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f2/a31c49135be94401aeec71151a77b7c6 2023-02-07 15:03:09,774 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f2/3ed8ae406cf249c2b3be3ab1cec0ce8b 2023-02-07 15:03:09,775 WARN [DataStreamer for file /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f2/2dc3ee1d753140a7865b39e2be9211c0] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-07 15:03:09,775 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f2/2dc3ee1d753140a7865b39e2be9211c0 2023-02-07 15:03:09,778 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f1/2fcc930802de481c871e2a0e442a6976 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1/2fcc930802de481c871e2a0e442a6976 2023-02-07 15:03:09,779 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f1/43d60b74144a46669fcf31fe2535e797 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1/43d60b74144a46669fcf31fe2535e797 2023-02-07 15:03:09,781 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f2/e968d21eadbe4704a249da3e6ab057cd 2023-02-07 15:03:09,784 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f1/6217c9590c1a47c79535b1697f4c8fdb as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1/6217c9590c1a47c79535b1697f4c8fdb 2023-02-07 15:03:09,785 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f1/a0ddf5c025544ceb9335c447888d7f6b as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1/a0ddf5c025544ceb9335c447888d7f6b 2023-02-07 15:03:09,787 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1/43d60b74144a46669fcf31fe2535e797, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,788 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1/2fcc930802de481c871e2a0e442a6976, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,790 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f2/d7ca5be343c54fbb9ced96346fab7330 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2/d7ca5be343c54fbb9ced96346fab7330 2023-02-07 15:03:09,790 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f1/39603cce918d4b9bb5371ca08cb70f2b as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1/39603cce918d4b9bb5371ca08cb70f2b 2023-02-07 15:03:09,790 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f2/a31c49135be94401aeec71151a77b7c6 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2/a31c49135be94401aeec71151a77b7c6 2023-02-07 15:03:09,793 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1/a0ddf5c025544ceb9335c447888d7f6b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,795 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f2/3ed8ae406cf249c2b3be3ab1cec0ce8b as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2/3ed8ae406cf249c2b3be3ab1cec0ce8b 2023-02-07 15:03:09,797 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1/39603cce918d4b9bb5371ca08cb70f2b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,799 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f2/e968d21eadbe4704a249da3e6ab057cd as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2/e968d21eadbe4704a249da3e6ab057cd 2023-02-07 15:03:09,809 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1/6217c9590c1a47c79535b1697f4c8fdb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,810 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f2/2dc3ee1d753140a7865b39e2be9211c0 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2/2dc3ee1d753140a7865b39e2be9211c0 2023-02-07 15:03:09,811 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2/3ed8ae406cf249c2b3be3ab1cec0ce8b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,811 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2/d7ca5be343c54fbb9ced96346fab7330, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,812 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e1642859e19b6de8bf9bffe58462f20b in 290ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:09,812 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d7d946692158ddfbfd3bb655e3c71360 in 295ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:09,813 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 15:03:09,812 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 15:03:09,813 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d7d946692158ddfbfd3bb655e3c71360: 2023-02-07 15:03:09,813 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,813 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,813 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1/a0ddf5c025544ceb9335c447888d7f6b] hfiles 2023-02-07 15:03:09,814 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1/a0ddf5c025544ceb9335c447888d7f6b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,814 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2/3ed8ae406cf249c2b3be3ab1cec0ce8b] hfiles 2023-02-07 15:03:09,814 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2/3ed8ae406cf249c2b3be3ab1cec0ce8b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,818 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2/2dc3ee1d753140a7865b39e2be9211c0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,819 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bfb63f50c3843ca8196811d685109aef in 310ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:09,824 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f2/9ffa44d1a6cd4e07a14fad725becccd4 2023-02-07 15:03:09,825 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e1642859e19b6de8bf9bffe58462f20b: 2023-02-07 15:03:09,825 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bfb63f50c3843ca8196811d685109aef: 2023-02-07 15:03:09,825 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1/43d60b74144a46669fcf31fe2535e797] hfiles 2023-02-07 15:03:09,825 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1/43d60b74144a46669fcf31fe2535e797 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2/d7ca5be343c54fbb9ced96346fab7330] hfiles 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1/6217c9590c1a47c79535b1697f4c8fdb] hfiles 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2/d7ca5be343c54fbb9ced96346fab7330 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1/6217c9590c1a47c79535b1697f4c8fdb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2/2dc3ee1d753140a7865b39e2be9211c0] hfiles 2023-02-07 15:03:09,826 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2/a31c49135be94401aeec71151a77b7c6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,826 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2/2dc3ee1d753140a7865b39e2be9211c0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,828 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 77764c0223c4c5a67e1df0e8dc611ac7 in 307ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 77764c0223c4c5a67e1df0e8dc611ac7: 2023-02-07 15:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1/2fcc930802de481c871e2a0e442a6976] hfiles 2023-02-07 15:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1/2fcc930802de481c871e2a0e442a6976 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2/a31c49135be94401aeec71151a77b7c6] hfiles 2023-02-07 15:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2/a31c49135be94401aeec71151a77b7c6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,833 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f1/29e132e4d7754c259e0b7b7b2fb2851d as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1/29e132e4d7754c259e0b7b7b2fb2851d 2023-02-07 15:03:09,838 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2/e968d21eadbe4704a249da3e6ab057cd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,839 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5809147126b1d00a96d9149aede55c62 in 331ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:09,839 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5809147126b1d00a96d9149aede55c62: 2023-02-07 15:03:09,839 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,839 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,839 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1/39603cce918d4b9bb5371ca08cb70f2b] hfiles 2023-02-07 15:03:09,839 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1/39603cce918d4b9bb5371ca08cb70f2b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,839 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2/e968d21eadbe4704a249da3e6ab057cd] hfiles 2023-02-07 15:03:09,839 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2/e968d21eadbe4704a249da3e6ab057cd for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,842 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1/29e132e4d7754c259e0b7b7b2fb2851d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,843 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f2/9ffa44d1a6cd4e07a14fad725becccd4 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2/9ffa44d1a6cd4e07a14fad725becccd4 2023-02-07 15:03:09,884 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. completed. 2023-02-07 15:03:09,884 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:09,884 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:09,884 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 15:03:09,884 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. started... 2023-02-07 15:03:09,884 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 79871bca5cdc3f41385c7b09cd0f3639 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 15:03:09,890 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2/9ffa44d1a6cd4e07a14fad725becccd4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:09,891 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4515ba2af0acbc3524e578aa3b6e31f1 in 234ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4515ba2af0acbc3524e578aa3b6e31f1: 2023-02-07 15:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1/29e132e4d7754c259e0b7b7b2fb2851d] hfiles 2023-02-07 15:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1/29e132e4d7754c259e0b7b7b2fb2851d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2/9ffa44d1a6cd4e07a14fad725becccd4] hfiles 2023-02-07 15:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2/9ffa44d1a6cd4e07a14fad725becccd4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,909 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. completed. 2023-02-07 15:03:09,910 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:09,910 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:09,910 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. started... 2023-02-07 15:03:09,910 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegion(2744): Flushing dbde7afb9ea91e7cd5e8b278733dbe5a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 15:03:09,910 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 15:03:09,920 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. completed. 2023-02-07 15:03:09,920 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:09,920 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 15:03:09,920 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. started... 2023-02-07 15:03:09,920 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b90841eb824d768a9bd46941e96b95bf: 2023-02-07 15:03:09,921 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:09,921 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:09,921 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:09,921 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:09,944 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. completed. 2023-02-07 15:03:09,944 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:09,944 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 15:03:09,964 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f1/88d98f980a774fb18f28f52731d5c09a 2023-02-07 15:03:09,977 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. completed. 2023-02-07 15:03:09,977 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 15:03:09,996 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f1/a3f4c0fc727a41e8b0c41fe0fab34e85 2023-02-07 15:03:09,996 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:09,996 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:09,997 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:09,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:03:09,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:09,999 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 15:03:10,000 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. completed. 2023-02-07 15:03:10,000 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:10,000 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 15:03:10,000 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 15:03:10,001 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,001 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-07 15:03:10,001 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35599,1675782186183' in zk 2023-02-07 15:03:10,010 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-07 15:03:10,010 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:10,010 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:10,011 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-07 15:03:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:10,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:10,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,018 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f2/ee48850056434859a3a08a51129d2924 2023-02-07 15:03:10,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35599,1675782186183': 2023-02-07 15:03:10,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35599,1675782186183' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 15:03:10,025 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f1/88d98f980a774fb18f28f52731d5c09a as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1/88d98f980a774fb18f28f52731d5c09a 2023-02-07 15:03:10,032 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1/88d98f980a774fb18f28f52731d5c09a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:10,033 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f2/ee48850056434859a3a08a51129d2924 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2/ee48850056434859a3a08a51129d2924 2023-02-07 15:03:10,036 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f2/cdc9e085d3d64257b2dcdc7da108f431 2023-02-07 15:03:10,039 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2/ee48850056434859a3a08a51129d2924, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:10,040 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 79871bca5cdc3f41385c7b09cd0f3639 in 156ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:10,040 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 79871bca5cdc3f41385c7b09cd0f3639: 2023-02-07 15:03:10,040 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1/88d98f980a774fb18f28f52731d5c09a] hfiles 2023-02-07 15:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1/88d98f980a774fb18f28f52731d5c09a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2/ee48850056434859a3a08a51129d2924] hfiles 2023-02-07 15:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2/ee48850056434859a3a08a51129d2924 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,042 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f1/a3f4c0fc727a41e8b0c41fe0fab34e85 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1/a3f4c0fc727a41e8b0c41fe0fab34e85 2023-02-07 15:03:10,048 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1/a3f4c0fc727a41e8b0c41fe0fab34e85, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:10,049 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f2/cdc9e085d3d64257b2dcdc7da108f431 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2/cdc9e085d3d64257b2dcdc7da108f431 2023-02-07 15:03:10,051 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. completed. 2023-02-07 15:03:10,051 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 15:03:10,056 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2/cdc9e085d3d64257b2dcdc7da108f431, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:10,057 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for dbde7afb9ea91e7cd5e8b278733dbe5a in 147ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for dbde7afb9ea91e7cd5e8b278733dbe5a: 2023-02-07 15:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1/a3f4c0fc727a41e8b0c41fe0fab34e85] hfiles 2023-02-07 15:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1/a3f4c0fc727a41e8b0c41fe0fab34e85 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2/cdc9e085d3d64257b2dcdc7da108f431] hfiles 2023-02-07 15:03:10,057 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2/cdc9e085d3d64257b2dcdc7da108f431 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,066 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. completed. 2023-02-07 15:03:10,066 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:10,066 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 15:03:10,303 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. completed. 2023-02-07 15:03:10,303 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:10,303 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 15:03:10,303 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 15:03:10,303 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,303 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-07 15:03:10,303 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,40983,1675782186221' in zk 2023-02-07 15:03:10,305 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,305 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-07 15:03:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:10,305 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:10,305 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-07 15:03:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:10,529 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:10,530 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:10,530 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:10,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:03:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,535 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-07 15:03:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,40983,1675782186221': 2023-02-07 15:03:10,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40983,1675782186221' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 15:03:10,538 INFO [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-07 15:03:10,538 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:10,538 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:10,538 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,538 INFO [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 15:03:10,540 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:10,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:10,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:10,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:10,541 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,542 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:10,544 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,544 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,552 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:10,552 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:10,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:10,552 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:10,552 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:10,552 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:10,552 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:10,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,552 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:10,552 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:10,553 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,554 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:10,554 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,554 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:10,554 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,554 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:10,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-07 15:03:10,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,619 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:10,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675782189387Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675782190552 (+1165 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675782190553 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675782190563 (+10 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675782190579 (+16 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675782190618 (+39 ms) 2023-02-07 15:03:10,621 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:03:10,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2330 sec 2023-02-07 15:03:11,535 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:11,536 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:11,536 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:11,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:03:11,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 15:03:11,538 INFO [Listener at localhost/45505] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 15:03:11,538 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:11,538 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:11,543 INFO [Listener at localhost/45505] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 15:03:11,551 INFO [Listener at localhost/45505] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 15:03:11,604 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35599] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:11,614 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40983] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:11,710 INFO [Listener at localhost/45505] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 15:03:11,715 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:11,715 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:11,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 15:03:11,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 15:03:11,721 INFO [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 15:03:11,721 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:11,722 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 15:03:11,722 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 15:03:11,722 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:11,722 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:11,724 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:11,724 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:11,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:11,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:11,724 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:11,725 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:11,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:11,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:11,725 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:11,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:11,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:11,725 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:11,725 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 15:03:11,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 15:03:11,728 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 15:03:11,728 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 15:03:11,728 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:11,728 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:11,729 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 15:03:11,729 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 15:03:11,730 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:11,730 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. started... 2023-02-07 15:03:11,730 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d7d946692158ddfbfd3bb655e3c71360 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:11,731 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:11,732 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. started... 2023-02-07 15:03:11,732 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:11,732 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. started... 2023-02-07 15:03:11,732 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5809147126b1d00a96d9149aede55c62 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:11,732 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 77764c0223c4c5a67e1df0e8dc611ac7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:11,737 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 15:03:11,737 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:11,737 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:11,737 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:11,737 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. started... 2023-02-07 15:03:11,737 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. started... 2023-02-07 15:03:11,737 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e1642859e19b6de8bf9bffe58462f20b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:11,737 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bfb63f50c3843ca8196811d685109aef 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:11,744 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 15:03:11,744 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:11,744 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:11,744 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. started... 2023-02-07 15:03:11,744 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8c0e0fe141e2d74cb3e983941db863a1: 2023-02-07 15:03:11,744 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:11,750 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:11,750 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. started... 2023-02-07 15:03:11,750 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4515ba2af0acbc3524e578aa3b6e31f1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 15:03:11,800 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f1/cf9dd5d992ea4bdcb41669e72191f9d2 2023-02-07 15:03:11,804 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f1/ebf4e1cc10de4d71b3f478b9da71d1dc 2023-02-07 15:03:11,805 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f1/e3df35442ab24b59a945bd26498b2a7d 2023-02-07 15:03:11,806 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f1/bdc10de8e3884550a63aa011d6c315ef 2023-02-07 15:03:11,857 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f2/1a0630393cc54ef9a439bb0c83342b3f 2023-02-07 15:03:11,859 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f2/4356f8518e1d4fd698079b9450eef4d7 2023-02-07 15:03:11,860 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f2/b08489361509401789ccb42a20131b89 2023-02-07 15:03:11,866 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f1/e3df35442ab24b59a945bd26498b2a7d as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1/e3df35442ab24b59a945bd26498b2a7d 2023-02-07 15:03:11,867 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f1/cf9dd5d992ea4bdcb41669e72191f9d2 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1/cf9dd5d992ea4bdcb41669e72191f9d2 2023-02-07 15:03:11,871 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f1/ebf4e1cc10de4d71b3f478b9da71d1dc as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1/ebf4e1cc10de4d71b3f478b9da71d1dc 2023-02-07 15:03:11,871 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f2/2b7f367eaea449789b59ebd9aed53d9f 2023-02-07 15:03:11,876 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1/cf9dd5d992ea4bdcb41669e72191f9d2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,876 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1/e3df35442ab24b59a945bd26498b2a7d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,877 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/.tmp/f2/1a0630393cc54ef9a439bb0c83342b3f as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2/1a0630393cc54ef9a439bb0c83342b3f 2023-02-07 15:03:11,880 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/.tmp/f2/4356f8518e1d4fd698079b9450eef4d7 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2/4356f8518e1d4fd698079b9450eef4d7 2023-02-07 15:03:11,884 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1/ebf4e1cc10de4d71b3f478b9da71d1dc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,884 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f1/bdc10de8e3884550a63aa011d6c315ef as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1/bdc10de8e3884550a63aa011d6c315ef 2023-02-07 15:03:11,886 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/.tmp/f2/b08489361509401789ccb42a20131b89 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2/b08489361509401789ccb42a20131b89 2023-02-07 15:03:11,888 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2/4356f8518e1d4fd698079b9450eef4d7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,888 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2/1a0630393cc54ef9a439bb0c83342b3f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,889 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5809147126b1d00a96d9149aede55c62 in 157ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:11,889 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5809147126b1d00a96d9149aede55c62: 2023-02-07 15:03:11,889 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:11,889 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:11,889 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 15:03:11,889 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. started... 2023-02-07 15:03:11,889 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b90841eb824d768a9bd46941e96b95bf: 2023-02-07 15:03:11,890 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:11,890 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e1642859e19b6de8bf9bffe58462f20b in 153ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:11,890 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 15:03:11,890 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e1642859e19b6de8bf9bffe58462f20b: 2023-02-07 15:03:11,890 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:11,890 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:11,890 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. started... 2023-02-07 15:03:11,890 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 79871bca5cdc3f41385c7b09cd0f3639 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 15:03:11,890 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 15:03:11,902 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2/b08489361509401789ccb42a20131b89, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,903 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1/bdc10de8e3884550a63aa011d6c315ef, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,904 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bfb63f50c3843ca8196811d685109aef in 167ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:11,904 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bfb63f50c3843ca8196811d685109aef: 2023-02-07 15:03:11,904 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:11,904 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 15:03:11,904 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/.tmp/f2/2b7f367eaea449789b59ebd9aed53d9f as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2/2b7f367eaea449789b59ebd9aed53d9f 2023-02-07 15:03:11,913 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2/2b7f367eaea449789b59ebd9aed53d9f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:11,915 INFO [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4515ba2af0acbc3524e578aa3b6e31f1 in 165ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:11,915 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4515ba2af0acbc3524e578aa3b6e31f1: 2023-02-07 15:03:11,915 DEBUG [rs(jenkins-hbase4.apache.org,35599,1675782186183)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:11,915 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 15:03:11,915 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 15:03:11,915 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:11,915 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 15:03:11,915 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35599,1675782186183' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 15:03:11,915 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f1/649a1b956f7e4000b30940589ca71b5a 2023-02-07 15:03:11,917 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:11,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35599,1675782186183' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 15:03:11,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dad14c6[Count = 1] remaining members to acquire global barrier 2023-02-07 15:03:11,929 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f2/504ebc5eab4a43f5a20a82fb460e5b89 2023-02-07 15:03:11,935 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f1/649a1b956f7e4000b30940589ca71b5a as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1/649a1b956f7e4000b30940589ca71b5a 2023-02-07 15:03:11,939 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1/649a1b956f7e4000b30940589ca71b5a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:11,940 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/.tmp/f2/504ebc5eab4a43f5a20a82fb460e5b89 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2/504ebc5eab4a43f5a20a82fb460e5b89 2023-02-07 15:03:11,945 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2/504ebc5eab4a43f5a20a82fb460e5b89, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:11,946 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 79871bca5cdc3f41385c7b09cd0f3639 in 56ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:11,946 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 79871bca5cdc3f41385c7b09cd0f3639: 2023-02-07 15:03:11,946 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:11,946 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:11,946 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 15:03:11,946 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. started... 2023-02-07 15:03:11,946 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing dbde7afb9ea91e7cd5e8b278733dbe5a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 15:03:11,955 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f1/3b71e867211e4875ba0984602a0d1c66 2023-02-07 15:03:11,967 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f2/58cebbca037d44fe92573945cfcb1491 2023-02-07 15:03:11,972 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f1/3b71e867211e4875ba0984602a0d1c66 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1/3b71e867211e4875ba0984602a0d1c66 2023-02-07 15:03:11,976 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1/3b71e867211e4875ba0984602a0d1c66, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:11,977 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/.tmp/f2/58cebbca037d44fe92573945cfcb1491 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2/58cebbca037d44fe92573945cfcb1491 2023-02-07 15:03:11,981 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2/58cebbca037d44fe92573945cfcb1491, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:11,982 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for dbde7afb9ea91e7cd5e8b278733dbe5a in 36ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:11,982 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dbde7afb9ea91e7cd5e8b278733dbe5a: 2023-02-07 15:03:11,982 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:11,982 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 15:03:12,192 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f1/2f2a69df998b4492878d023e8444c66a 2023-02-07 15:03:12,204 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f2/0ef8196ccb6045e9aca91c2d77e07297 2023-02-07 15:03:12,207 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f1/9db2f3d94e9b4abc9bcc08ce18e31d7b 2023-02-07 15:03:12,209 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f1/2f2a69df998b4492878d023e8444c66a as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1/2f2a69df998b4492878d023e8444c66a 2023-02-07 15:03:12,214 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1/2f2a69df998b4492878d023e8444c66a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:12,215 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/.tmp/f2/0ef8196ccb6045e9aca91c2d77e07297 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2/0ef8196ccb6045e9aca91c2d77e07297 2023-02-07 15:03:12,220 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2/0ef8196ccb6045e9aca91c2d77e07297, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:12,221 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d7d946692158ddfbfd3bb655e3c71360 in 491ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:12,221 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d7d946692158ddfbfd3bb655e3c71360: 2023-02-07 15:03:12,221 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:12,221 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 15:03:12,227 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f2/36bd1c50d06a4426ae9e4c7ed7bc21bf 2023-02-07 15:03:12,232 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f1/9db2f3d94e9b4abc9bcc08ce18e31d7b as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1/9db2f3d94e9b4abc9bcc08ce18e31d7b 2023-02-07 15:03:12,238 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1/9db2f3d94e9b4abc9bcc08ce18e31d7b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:12,239 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/.tmp/f2/36bd1c50d06a4426ae9e4c7ed7bc21bf as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2/36bd1c50d06a4426ae9e4c7ed7bc21bf 2023-02-07 15:03:12,243 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2/36bd1c50d06a4426ae9e4c7ed7bc21bf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:12,244 INFO [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 77764c0223c4c5a67e1df0e8dc611ac7 in 512ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:12,245 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 77764c0223c4c5a67e1df0e8dc611ac7: 2023-02-07 15:03:12,245 DEBUG [rs(jenkins-hbase4.apache.org,40983,1675782186221)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:12,245 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 15:03:12,245 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 15:03:12,245 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,245 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 15:03:12,245 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40983,1675782186221' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 15:03:12,246 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,246 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:12,247 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,247 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:12,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40983,1675782186221' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 15:03:12,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dad14c6[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:12,249 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 15:03:12,249 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,253 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,253 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 15:03:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 15:03:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 15:03:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 15:03:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35599,1675782186183' in zk 2023-02-07 15:03:12,253 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40983,1675782186221' in zk 2023-02-07 15:03:12,254 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,254 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:12,255 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 15:03:12,255 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,255 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:12,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:12,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:12,255 DEBUG [member: 'jenkins-hbase4.apache.org,40983,1675782186221' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 15:03:12,257 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,256 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 15:03:12,257 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:12,257 DEBUG [member: 'jenkins-hbase4.apache.org,35599,1675782186183' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 15:03:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40983,1675782186221': 2023-02-07 15:03:12,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40983,1675782186221' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-07 15:03:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35599,1675782186183': 2023-02-07 15:03:12,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35599,1675782186183' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 15:03:12,264 INFO [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 15:03:12,264 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:12,264 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:12,264 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 15:03:12,264 INFO [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 15:03:12,265 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,265 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,265 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:12,265 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,266 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:12,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:12,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:12,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,266 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:12,267 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:12,269 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:12,269 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,273 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,273 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:12,274 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:12,274 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:12,273 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:12,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:12,274 DEBUG [(jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:12,274 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,274 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:12,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:12,275 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:12,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 15:03:12,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 15:03:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:12,275 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:12,275 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,275 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,275 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:12,275 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:12,276 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:12,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:12,276 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 15:03:12,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:12,376 DEBUG [Listener at localhost/45505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 15:03:12,376 INFO [Listener at localhost/45505] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:12,376 INFO [Listener at localhost/45505] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:12,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 15:03:12,378 INFO [Listener at localhost/45505] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 15:03:12,378 DEBUG [Listener at localhost/45505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d3db339 to 127.0.0.1:58177 2023-02-07 15:03:12,378 DEBUG [Listener at localhost/45505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:12,379 DEBUG [Listener at localhost/45505] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 15:03:12,379 DEBUG [Listener at localhost/45505] util.JVMClusterUtil(257): Found active master hash=986167905, stopped=false 2023-02-07 15:03:12,379 INFO [Listener at localhost/45505] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:12,380 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:12,380 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:12,380 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:12,381 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:12,381 INFO [Listener at localhost/45505] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 15:03:12,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:12,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:12,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:12,383 DEBUG [Listener at localhost/45505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4192dbe7 to 127.0.0.1:58177 2023-02-07 15:03:12,384 DEBUG [Listener at localhost/45505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:12,384 INFO [Listener at localhost/45505] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35599,1675782186183' ***** 2023-02-07 15:03:12,385 INFO [Listener at localhost/45505] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:12,385 INFO [Listener at localhost/45505] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40983,1675782186221' ***** 2023-02-07 15:03:12,385 INFO [Listener at localhost/45505] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:12,385 INFO [RS:0;jenkins-hbase4:35599] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:12,385 INFO [RS:0;jenkins-hbase4:35599] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:12,385 INFO [RS:0;jenkins-hbase4:35599] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:12,385 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:12,386 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(3304): Received CLOSE for 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:12,386 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(3304): Received CLOSE for e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:12,386 INFO [RS:1;jenkins-hbase4:40983] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:12,386 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(3304): Received CLOSE for bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:12,386 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:12,386 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(3304): Received CLOSE for 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:12,386 INFO [RS:1;jenkins-hbase4:40983] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:12,387 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(3304): Received CLOSE for 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:12,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5809147126b1d00a96d9149aede55c62, disabling compactions & flushes 2023-02-07 15:03:12,387 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(3304): Received CLOSE for b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:12,387 INFO [RS:1;jenkins-hbase4:40983] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:12,387 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:12,388 DEBUG [RS:0;jenkins-hbase4:35599] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x706d55b5 to 127.0.0.1:58177 2023-02-07 15:03:12,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:12,388 DEBUG [RS:0;jenkins-hbase4:35599] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:12,388 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(3304): Received CLOSE for d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:12,388 INFO [RS:0;jenkins-hbase4:35599] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:12,388 INFO [RS:0;jenkins-hbase4:35599] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:12,388 INFO [RS:0;jenkins-hbase4:35599] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:12,388 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(3304): Received CLOSE for 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:12,388 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 15:03:12,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d7d946692158ddfbfd3bb655e3c71360, disabling compactions & flushes 2023-02-07 15:03:12,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. after waiting 0 ms 2023-02-07 15:03:12,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:12,388 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(3304): Received CLOSE for e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:12,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:12,388 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(3304): Received CLOSE for 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:12,388 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-07 15:03:12,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:12,389 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1479): Online Regions={5809147126b1d00a96d9149aede55c62=testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62., e5e1a382a5128222ac9c9beaffd3a7ff=hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff., 1588230740=hbase:meta,,1.1588230740, bfb63f50c3843ca8196811d685109aef=testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef., 8c0e0fe141e2d74cb3e983941db863a1=testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1., 4515ba2af0acbc3524e578aa3b6e31f1=testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1., b90841eb824d768a9bd46941e96b95bf=testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.} 2023-02-07 15:03:12,389 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(3304): Received CLOSE for dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:12,389 DEBUG [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1505): Waiting on 1588230740, 4515ba2af0acbc3524e578aa3b6e31f1, 5809147126b1d00a96d9149aede55c62, 8c0e0fe141e2d74cb3e983941db863a1, b90841eb824d768a9bd46941e96b95bf, bfb63f50c3843ca8196811d685109aef, e5e1a382a5128222ac9c9beaffd3a7ff 2023-02-07 15:03:12,389 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. after waiting 0 ms 2023-02-07 15:03:12,388 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:12,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:12,389 DEBUG [RS:1;jenkins-hbase4:40983] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x025c0571 to 127.0.0.1:58177 2023-02-07 15:03:12,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:12,389 DEBUG [RS:1;jenkins-hbase4:40983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:12,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:12,389 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-07 15:03:12,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:12,389 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1479): Online Regions={d7d946692158ddfbfd3bb655e3c71360=testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360., 77764c0223c4c5a67e1df0e8dc611ac7=testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7., e1642859e19b6de8bf9bffe58462f20b=testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b., 79871bca5cdc3f41385c7b09cd0f3639=testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639., dbde7afb9ea91e7cd5e8b278733dbe5a=testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.} 2023-02-07 15:03:12,390 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:12,390 DEBUG [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1505): Waiting on 77764c0223c4c5a67e1df0e8dc611ac7, 79871bca5cdc3f41385c7b09cd0f3639, d7d946692158ddfbfd3bb655e3c71360, dbde7afb9ea91e7cd5e8b278733dbe5a, e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:12,390 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-07 15:03:12,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:12,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d7d946692158ddfbfd3bb655e3c71360: Waiting for close lock at 1675782192388Running coprocessor pre-close hooks at 1675782192388Disabling compacts and flushes for region at 1675782192388Disabling writes for close at 1675782192389 (+1 ms)Writing region close event to WAL at 1675782192403 (+14 ms)Running coprocessor post-close hooks at 1675782192407 (+4 ms)Closed at 1675782192408 (+1 ms) 2023-02-07 15:03:12,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:12,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 77764c0223c4c5a67e1df0e8dc611ac7, disabling compactions & flushes 2023-02-07 15:03:12,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:12,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:12,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. after waiting 0 ms 2023-02-07 15:03:12,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:12,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:12,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5809147126b1d00a96d9149aede55c62: Waiting for close lock at 1675782192386Running coprocessor pre-close hooks at 1675782192386Disabling compacts and flushes for region at 1675782192386Disabling writes for close at 1675782192388 (+2 ms)Writing region close event to WAL at 1675782192400 (+12 ms)Running coprocessor post-close hooks at 1675782192408 (+8 ms)Closed at 1675782192412 (+4 ms) 2023-02-07 15:03:12,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:12,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e5e1a382a5128222ac9c9beaffd3a7ff, disabling compactions & flushes 2023-02-07 15:03:12,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:12,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:12,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. after waiting 0 ms 2023-02-07 15:03:12,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:12,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e5e1a382a5128222ac9c9beaffd3a7ff 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 15:03:12,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/.tmp/info/149e58494cd743e6b85bc71f1d848da0 2023-02-07 15:03:12,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:12,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 77764c0223c4c5a67e1df0e8dc611ac7: Waiting for close lock at 1675782192408Running coprocessor pre-close hooks at 1675782192408Disabling compacts and flushes for region at 1675782192408Disabling writes for close at 1675782192408Writing region close event to WAL at 1675782192418 (+10 ms)Running coprocessor post-close hooks at 1675782192428 (+10 ms)Closed at 1675782192429 (+1 ms) 2023-02-07 15:03:12,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:12,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e1642859e19b6de8bf9bffe58462f20b, disabling compactions & flushes 2023-02-07 15:03:12,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:12,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:12,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. after waiting 0 ms 2023-02-07 15:03:12,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:12,431 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:12,431 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:12,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/.tmp/info/b45f521504834505a63d77897f101695 2023-02-07 15:03:12,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:12,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e1642859e19b6de8bf9bffe58462f20b: Waiting for close lock at 1675782192429Running coprocessor pre-close hooks at 1675782192429Disabling compacts and flushes for region at 1675782192429Disabling writes for close at 1675782192429Writing region close event to WAL at 1675782192453 (+24 ms)Running coprocessor post-close hooks at 1675782192460 (+7 ms)Closed at 1675782192461 (+1 ms) 2023-02-07 15:03:12,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:12,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 79871bca5cdc3f41385c7b09cd0f3639, disabling compactions & flushes 2023-02-07 15:03:12,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:12,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:12,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. after waiting 0 ms 2023-02-07 15:03:12,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:12,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/.tmp/table/3ea2b4c12cbd48d8babcaaf52c39d07d 2023-02-07 15:03:12,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/.tmp/info/b45f521504834505a63d77897f101695 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/info/b45f521504834505a63d77897f101695 2023-02-07 15:03:12,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:12,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 79871bca5cdc3f41385c7b09cd0f3639: Waiting for close lock at 1675782192461Running coprocessor pre-close hooks at 1675782192461Disabling compacts and flushes for region at 1675782192461Disabling writes for close at 1675782192461Writing region close event to WAL at 1675782192463 (+2 ms)Running coprocessor post-close hooks at 1675782192471 (+8 ms)Closed at 1675782192471 2023-02-07 15:03:12,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:12,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dbde7afb9ea91e7cd5e8b278733dbe5a, disabling compactions & flushes 2023-02-07 15:03:12,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:12,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:12,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. after waiting 0 ms 2023-02-07 15:03:12,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:12,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/info/b45f521504834505a63d77897f101695, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 15:03:12,474 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/.tmp/info/149e58494cd743e6b85bc71f1d848da0 as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/info/149e58494cd743e6b85bc71f1d848da0 2023-02-07 15:03:12,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e5e1a382a5128222ac9c9beaffd3a7ff in 63ms, sequenceid=6, compaction requested=false 2023-02-07 15:03:12,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-07 15:03:12,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:12,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dbde7afb9ea91e7cd5e8b278733dbe5a: Waiting for close lock at 1675782192472Running coprocessor pre-close hooks at 1675782192472Disabling compacts and flushes for region at 1675782192472Disabling writes for close at 1675782192472Writing region close event to WAL at 1675782192473 (+1 ms)Running coprocessor post-close hooks at 1675782192479 (+6 ms)Closed at 1675782192480 (+1 ms) 2023-02-07 15:03:12,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:12,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/namespace/e5e1a382a5128222ac9c9beaffd3a7ff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 15:03:12,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:12,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/info/149e58494cd743e6b85bc71f1d848da0, entries=110, sequenceid=32, filesize=18.7 K 2023-02-07 15:03:12,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e5e1a382a5128222ac9c9beaffd3a7ff: Waiting for close lock at 1675782192414Running coprocessor pre-close hooks at 1675782192414Disabling compacts and flushes for region at 1675782192414Disabling writes for close at 1675782192414Obtaining lock to block concurrent updates at 1675782192414Preparing flush snapshotting stores in e5e1a382a5128222ac9c9beaffd3a7ff at 1675782192414Finished memstore snapshotting hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675782192415 (+1 ms)Flushing stores of hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. at 1675782192418 (+3 ms)Flushing e5e1a382a5128222ac9c9beaffd3a7ff/info: creating writer at 1675782192418Flushing e5e1a382a5128222ac9c9beaffd3a7ff/info: appending metadata at 1675782192425 (+7 ms)Flushing e5e1a382a5128222ac9c9beaffd3a7ff/info: closing flushed file at 1675782192426 (+1 ms)Flushing e5e1a382a5128222ac9c9beaffd3a7ff/info: reopening flushed file at 1675782192469 (+43 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e5e1a382a5128222ac9c9beaffd3a7ff in 63ms, sequenceid=6, compaction requested=false at 1675782192477 (+8 ms)Writing region close event to WAL at 1675782192478 (+1 ms)Running coprocessor post-close hooks at 1675782192483 (+5 ms)Closed at 1675782192484 (+1 ms) 2023-02-07 15:03:12,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675782186912.e5e1a382a5128222ac9c9beaffd3a7ff. 2023-02-07 15:03:12,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bfb63f50c3843ca8196811d685109aef, disabling compactions & flushes 2023-02-07 15:03:12,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:12,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:12,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. after waiting 0 ms 2023-02-07 15:03:12,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:12,485 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/.tmp/table/3ea2b4c12cbd48d8babcaaf52c39d07d as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/table/3ea2b4c12cbd48d8babcaaf52c39d07d 2023-02-07 15:03:12,489 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/table/3ea2b4c12cbd48d8babcaaf52c39d07d, entries=4, sequenceid=32, filesize=4.8 K 2023-02-07 15:03:12,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=32, compaction requested=false 2023-02-07 15:03:12,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-07 15:03:12,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,496 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-07 15:03:12,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:12,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bfb63f50c3843ca8196811d685109aef: Waiting for close lock at 1675782192484Running coprocessor pre-close hooks at 1675782192484Disabling compacts and flushes for region at 1675782192484Disabling writes for close at 1675782192484Writing region close event to WAL at 1675782192492 (+8 ms)Running coprocessor post-close hooks at 1675782192496 (+4 ms)Closed at 1675782192498 (+2 ms) 2023-02-07 15:03:12,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:12,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:12,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:12,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8c0e0fe141e2d74cb3e983941db863a1, disabling compactions & flushes 2023-02-07 15:03:12,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782192388Running coprocessor pre-close hooks at 1675782192388Disabling compacts and flushes for region at 1675782192388Disabling writes for close at 1675782192390 (+2 ms)Obtaining lock to block concurrent updates at 1675782192390Preparing flush snapshotting stores in 1588230740 at 1675782192390Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675782192390Flushing stores of hbase:meta,,1.1588230740 at 1675782192392 (+2 ms)Flushing 1588230740/info: creating writer at 1675782192394 (+2 ms)Flushing 1588230740/info: appending metadata at 1675782192405 (+11 ms)Flushing 1588230740/info: closing flushed file at 1675782192405Flushing 1588230740/table: creating writer at 1675782192437 (+32 ms)Flushing 1588230740/table: appending metadata at 1675782192453 (+16 ms)Flushing 1588230740/table: closing flushed file at 1675782192453Flushing 1588230740/info: reopening flushed file at 1675782192475 (+22 ms)Flushing 1588230740/table: reopening flushed file at 1675782192485 (+10 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=32, compaction requested=false at 1675782192490 (+5 ms)Writing region close event to WAL at 1675782192493 (+3 ms)Running coprocessor post-close hooks at 1675782192498 (+5 ms)Closed at 1675782192498 2023-02-07 15:03:12,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:12,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:12,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:12,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. after waiting 0 ms 2023-02-07 15:03:12,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 15:03:12,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8c0e0fe141e2d74cb3e983941db863a1: Waiting for close lock at 1675782192498Running coprocessor pre-close hooks at 1675782192498Disabling compacts and flushes for region at 1675782192498Disabling writes for close at 1675782192499 (+1 ms)Writing region close event to WAL at 1675782192499Running coprocessor post-close hooks at 1675782192502 (+3 ms)Closed at 1675782192502 2023-02-07 15:03:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4515ba2af0acbc3524e578aa3b6e31f1, disabling compactions & flushes 2023-02-07 15:03:12,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. after waiting 0 ms 2023-02-07 15:03:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:12,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:12,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4515ba2af0acbc3524e578aa3b6e31f1: Waiting for close lock at 1675782192502Running coprocessor pre-close hooks at 1675782192502Disabling compacts and flushes for region at 1675782192502Disabling writes for close at 1675782192502Writing region close event to WAL at 1675782192504 (+2 ms)Running coprocessor post-close hooks at 1675782192507 (+3 ms)Closed at 1675782192507 2023-02-07 15:03:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b90841eb824d768a9bd46941e96b95bf, disabling compactions & flushes 2023-02-07 15:03:12,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. after waiting 0 ms 2023-02-07 15:03:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 15:03:12,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b90841eb824d768a9bd46941e96b95bf: Waiting for close lock at 1675782192507Running coprocessor pre-close hooks at 1675782192507Disabling compacts and flushes for region at 1675782192507Disabling writes for close at 1675782192507Writing region close event to WAL at 1675782192507Running coprocessor post-close hooks at 1675782192510 (+3 ms)Closed at 1675782192510 2023-02-07 15:03:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:12,544 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 15:03:12,544 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 15:03:12,589 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35599,1675782186183; all regions closed. 2023-02-07 15:03:12,590 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40983,1675782186221; all regions closed. 2023-02-07 15:03:12,594 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/WALs/jenkins-hbase4.apache.org,40983,1675782186221/jenkins-hbase4.apache.org%2C40983%2C1675782186221.1675782187577 not finished, retry = 0 2023-02-07 15:03:12,596 DEBUG [RS:0;jenkins-hbase4:35599] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/oldWALs 2023-02-07 15:03:12,596 INFO [RS:0;jenkins-hbase4:35599] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35599%2C1675782186183.meta:.meta(num 1675782186847) 2023-02-07 15:03:12,601 DEBUG [RS:0;jenkins-hbase4:35599] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/oldWALs 2023-02-07 15:03:12,601 INFO [RS:0;jenkins-hbase4:35599] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35599%2C1675782186183:(num 1675782187578) 2023-02-07 15:03:12,601 DEBUG [RS:0;jenkins-hbase4:35599] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:12,601 INFO [RS:0;jenkins-hbase4:35599] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:12,601 INFO [RS:0;jenkins-hbase4:35599] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:12,602 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:12,602 INFO [RS:0;jenkins-hbase4:35599] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35599 2023-02-07 15:03:12,606 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,606 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:12,606 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35599,1675782186183 2023-02-07 15:03:12,606 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:12,606 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:12,606 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35599,1675782186183] 2023-02-07 15:03:12,606 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35599,1675782186183; numProcessing=1 2023-02-07 15:03:12,606 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 15:03:12,607 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 15:03:12,607 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35599,1675782186183 already deleted, retry=false 2023-02-07 15:03:12,608 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35599,1675782186183 expired; onlineServers=1 2023-02-07 15:03:12,697 DEBUG [RS:1;jenkins-hbase4:40983] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/oldWALs 2023-02-07 15:03:12,697 INFO [RS:1;jenkins-hbase4:40983] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40983%2C1675782186221:(num 1675782187577) 2023-02-07 15:03:12,697 DEBUG [RS:1;jenkins-hbase4:40983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:12,697 INFO [RS:1;jenkins-hbase4:40983] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:12,697 INFO [RS:1;jenkins-hbase4:40983] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:12,697 INFO [RS:1;jenkins-hbase4:40983] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:12,697 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:12,697 INFO [RS:1;jenkins-hbase4:40983] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:12,698 INFO [RS:1;jenkins-hbase4:40983] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:12,698 INFO [RS:1;jenkins-hbase4:40983] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40983 2023-02-07 15:03:12,702 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40983,1675782186221 2023-02-07 15:03:12,702 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:12,702 ERROR [Listener at localhost/45505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6c731574 rejected from java.util.concurrent.ThreadPoolExecutor@684c8c22[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:12,703 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40983,1675782186221] 2023-02-07 15:03:12,703 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40983,1675782186221; numProcessing=2 2023-02-07 15:03:12,704 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40983,1675782186221 already deleted, retry=false 2023-02-07 15:03:12,704 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40983,1675782186221 expired; onlineServers=0 2023-02-07 15:03:12,704 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36585,1675782186118' ***** 2023-02-07 15:03:12,704 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 15:03:12,705 DEBUG [M:0;jenkins-hbase4:36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bfab05a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:12,705 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36585,1675782186118 2023-02-07 15:03:12,705 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36585,1675782186118; all regions closed. 2023-02-07 15:03:12,705 DEBUG [M:0;jenkins-hbase4:36585] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:12,705 DEBUG [M:0;jenkins-hbase4:36585] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 15:03:12,705 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 15:03:12,705 DEBUG [M:0;jenkins-hbase4:36585] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 15:03:12,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782186435] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782186435,5,FailOnTimeoutGroup] 2023-02-07 15:03:12,706 INFO [M:0;jenkins-hbase4:36585] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 15:03:12,706 INFO [M:0;jenkins-hbase4:36585] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 15:03:12,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782186435] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782186435,5,FailOnTimeoutGroup] 2023-02-07 15:03:12,706 INFO [M:0;jenkins-hbase4:36585] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 15:03:12,707 DEBUG [M:0;jenkins-hbase4:36585] master.HMaster(1502): Stopping service threads 2023-02-07 15:03:12,707 INFO [M:0;jenkins-hbase4:36585] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 15:03:12,707 ERROR [M:0;jenkins-hbase4:36585] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 15:03:12,707 INFO [M:0;jenkins-hbase4:36585] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 15:03:12,707 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 15:03:12,707 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:12,707 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:12,708 DEBUG [M:0;jenkins-hbase4:36585] zookeeper.ZKUtil(398): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 15:03:12,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:12,708 WARN [M:0;jenkins-hbase4:36585] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 15:03:12,708 INFO [M:0;jenkins-hbase4:36585] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 15:03:12,708 INFO [M:0;jenkins-hbase4:36585] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 15:03:12,708 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:12,708 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:12,708 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:12,709 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:12,709 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:12,709 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-07 15:03:12,718 INFO [M:0;jenkins-hbase4:36585] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bef6ad0f23464de78f1cf960e70e0aba 2023-02-07 15:03:12,723 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bef6ad0f23464de78f1cf960e70e0aba as hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bef6ad0f23464de78f1cf960e70e0aba 2023-02-07 15:03:12,727 INFO [M:0;jenkins-hbase4:36585] regionserver.HStore(1080): Added hdfs://localhost:46571/user/jenkins/test-data/143c131c-34a2-7f7a-2e94-ed4096081417/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bef6ad0f23464de78f1cf960e70e0aba, entries=31, sequenceid=218, filesize=9.0 K 2023-02-07 15:03:12,728 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false 2023-02-07 15:03:12,729 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:12,729 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782192708Disabling compacts and flushes for region at 1675782192708Disabling writes for close at 1675782192709 (+1 ms)Obtaining lock to block concurrent updates at 1675782192709Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675782192709Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103374, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675782192709Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675782192710 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675782192710Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675782192712 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675782192712Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675782192724 (+12 ms)Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false at 1675782192728 (+4 ms)Writing region close event to WAL at 1675782192729 (+1 ms)Closed at 1675782192729 2023-02-07 15:03:12,733 INFO [M:0;jenkins-hbase4:36585] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 15:03:12,733 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:12,734 INFO [M:0;jenkins-hbase4:36585] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36585 2023-02-07 15:03:12,737 DEBUG [M:0;jenkins-hbase4:36585] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36585,1675782186118 already deleted, retry=false 2023-02-07 15:03:12,882 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:12,882 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36585,1675782186118; zookeeper connection closed. 2023-02-07 15:03:12,882 ERROR [Listener at localhost/45505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@96d2af1 rejected from java.util.concurrent.ThreadPoolExecutor@d52af04[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:12,883 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1002f4ece2e0000, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:12,883 ERROR [Listener at localhost/45505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1908c4d0 rejected from java.util.concurrent.ThreadPoolExecutor@d52af04[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:12,982 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:12,982 INFO [RS:1;jenkins-hbase4:40983] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40983,1675782186221; zookeeper connection closed. 2023-02-07 15:03:12,982 ERROR [Listener at localhost/45505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6805f3c3 rejected from java.util.concurrent.ThreadPoolExecutor@684c8c22[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:12,982 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:40983-0x1002f4ece2e0002, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:12,982 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1697dee3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1697dee3 2023-02-07 15:03:12,982 ERROR [Listener at localhost/45505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10082129 rejected from java.util.concurrent.ThreadPoolExecutor@684c8c22[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:13,082 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:13,082 INFO [RS:0;jenkins-hbase4:35599] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35599,1675782186183; zookeeper connection closed. 2023-02-07 15:03:13,082 ERROR [Listener at localhost/45505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c481514 rejected from java.util.concurrent.ThreadPoolExecutor@8778045[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:13,083 DEBUG [Listener at localhost/45505-EventThread] zookeeper.ZKWatcher(600): regionserver:35599-0x1002f4ece2e0001, quorum=127.0.0.1:58177, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:13,083 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@28719eda] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@28719eda 2023-02-07 15:03:13,083 ERROR [Listener at localhost/45505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30de93f7 rejected from java.util.concurrent.ThreadPoolExecutor@8778045[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:13,083 INFO [Listener at localhost/45505] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 15:03:13,171 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop-8095565552766933221.jar 2023-02-07 15:03:13,175 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675782189368 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:13,175 DEBUG [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:13,176 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(239): region to add: b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=d7d946692158ddfbfd3bb655e3c71360 as d7d946692158ddfbfd3bb655e3c71360 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=77764c0223c4c5a67e1df0e8dc611ac7 as 77764c0223c4c5a67e1df0e8dc611ac7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=5809147126b1d00a96d9149aede55c62 as 5809147126b1d00a96d9149aede55c62 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=e1642859e19b6de8bf9bffe58462f20b as e1642859e19b6de8bf9bffe58462f20b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=79871bca5cdc3f41385c7b09cd0f3639 as 79871bca5cdc3f41385c7b09cd0f3639 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=bfb63f50c3843ca8196811d685109aef as bfb63f50c3843ca8196811d685109aef in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=8c0e0fe141e2d74cb3e983941db863a1 as 8c0e0fe141e2d74cb3e983941db863a1 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=4515ba2af0acbc3524e578aa3b6e31f1 as 4515ba2af0acbc3524e578aa3b6e31f1 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=dbde7afb9ea91e7cd5e8b278733dbe5a as dbde7afb9ea91e7cd5e8b278733dbe5a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,177 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(585): clone region=b90841eb824d768a9bd46941e96b95bf as b90841eb824d768a9bd46941e96b95bf in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 15:03:13,178 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d7d946692158ddfbfd3bb655e3c71360, NAME => 'testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,185 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 4515ba2af0acbc3524e578aa3b6e31f1, NAME => 'testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,185 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 79871bca5cdc3f41385c7b09cd0f3639, NAME => 'testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,186 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => bfb63f50c3843ca8196811d685109aef, NAME => 'testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,186 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 77764c0223c4c5a67e1df0e8dc611ac7, NAME => 'testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,186 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e1642859e19b6de8bf9bffe58462f20b, NAME => 'testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,186 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5809147126b1d00a96d9149aede55c62, NAME => 'testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,186 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 8c0e0fe141e2d74cb3e983941db863a1, NAME => 'testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,204 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,205 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0ddf5c025544ceb9335c447888d7f6b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,216 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,216 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 43d60b74144a46669fcf31fe2535e797 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,220 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,220 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 88d98f980a774fb18f28f52731d5c09a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,221 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,221 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 39603cce918d4b9bb5371ca08cb70f2b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,229 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,229 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ed8ae406cf249c2b3be3ab1cec0ce8b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,229 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 29e132e4d7754c259e0b7b7b2fb2851d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,229 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee48850056434859a3a08a51129d2924 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,229 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d7ca5be343c54fbb9ced96346fab7330 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,230 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e968d21eadbe4704a249da3e6ab057cd from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 8c0e0fe141e2d74cb3e983941db863a1, disabling compactions & flushes 2023-02-07 15:03:13,232 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:13,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:13,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. after waiting 0 ms 2023-02-07 15:03:13,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:13,232 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:13,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 8c0e0fe141e2d74cb3e983941db863a1: Waiting for close lock at 1675782193232Disabling compacts and flushes for region at 1675782193232Disabling writes for close at 1675782193232Writing region close event to WAL at 1675782193232Closed at 1675782193232 2023-02-07 15:03:13,233 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => dbde7afb9ea91e7cd5e8b278733dbe5a, NAME => 'testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,233 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,233 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2fcc930802de481c871e2a0e442a6976 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,236 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e1642859e19b6de8bf9bffe58462f20b, disabling compactions & flushes 2023-02-07 15:03:13,236 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:13,236 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:13,236 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. after waiting 0 ms 2023-02-07 15:03:13,236 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:13,236 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:13,236 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e1642859e19b6de8bf9bffe58462f20b: Waiting for close lock at 1675782193236Disabling compacts and flushes for region at 1675782193236Disabling writes for close at 1675782193236Writing region close event to WAL at 1675782193236Closed at 1675782193236 2023-02-07 15:03:13,237 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b90841eb824d768a9bd46941e96b95bf, NAME => 'testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d7d946692158ddfbfd3bb655e3c71360, disabling compactions & flushes 2023-02-07 15:03:13,237 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. after waiting 0 ms 2023-02-07 15:03:13,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,237 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d7d946692158ddfbfd3bb655e3c71360: Waiting for close lock at 1675782193237Disabling compacts and flushes for region at 1675782193237Disabling writes for close at 1675782193237Writing region close event to WAL at 1675782193237Closed at 1675782193237 2023-02-07 15:03:13,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 79871bca5cdc3f41385c7b09cd0f3639, disabling compactions & flushes 2023-02-07 15:03:13,239 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:13,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:13,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. after waiting 0 ms 2023-02-07 15:03:13,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:13,239 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:13,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 79871bca5cdc3f41385c7b09cd0f3639: Waiting for close lock at 1675782193239Disabling compacts and flushes for region at 1675782193239Disabling writes for close at 1675782193239Writing region close event to WAL at 1675782193239Closed at 1675782193239 2023-02-07 15:03:13,241 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,242 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6217c9590c1a47c79535b1697f4c8fdb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,242 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ffa44d1a6cd4e07a14fad725becccd4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,242 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 5809147126b1d00a96d9149aede55c62, disabling compactions & flushes 2023-02-07 15:03:13,242 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,242 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a31c49135be94401aeec71151a77b7c6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,242 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,242 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. after waiting 0 ms 2023-02-07 15:03:13,242 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,242 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,242 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 5809147126b1d00a96d9149aede55c62: Waiting for close lock at 1675782193242Disabling compacts and flushes for region at 1675782193242Disabling writes for close at 1675782193242Writing region close event to WAL at 1675782193242Closed at 1675782193242 2023-02-07 15:03:13,245 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2dc3ee1d753140a7865b39e2be9211c0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,245 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 4515ba2af0acbc3524e578aa3b6e31f1, disabling compactions & flushes 2023-02-07 15:03:13,245 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 77764c0223c4c5a67e1df0e8dc611ac7, disabling compactions & flushes 2023-02-07 15:03:13,246 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,246 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. after waiting 0 ms 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,246 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. after waiting 0 ms 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 4515ba2af0acbc3524e578aa3b6e31f1: Waiting for close lock at 1675782193245Disabling compacts and flushes for region at 1675782193245Disabling writes for close at 1675782193246 (+1 ms)Writing region close event to WAL at 1675782193246Closed at 1675782193246 2023-02-07 15:03:13,246 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,246 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 77764c0223c4c5a67e1df0e8dc611ac7: Waiting for close lock at 1675782193245Disabling compacts and flushes for region at 1675782193245Disabling writes for close at 1675782193246 (+1 ms)Writing region close event to WAL at 1675782193246Closed at 1675782193246 2023-02-07 15:03:13,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing bfb63f50c3843ca8196811d685109aef, disabling compactions & flushes 2023-02-07 15:03:13,248 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. after waiting 0 ms 2023-02-07 15:03:13,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,248 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for bfb63f50c3843ca8196811d685109aef: Waiting for close lock at 1675782193248Disabling compacts and flushes for region at 1675782193248Disabling writes for close at 1675782193248Writing region close event to WAL at 1675782193248Closed at 1675782193248 2023-02-07 15:03:13,249 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,249 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a3f4c0fc727a41e8b0c41fe0fab34e85 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,251 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cdc9e085d3d64257b2dcdc7da108f431 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 15:03:13,252 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b90841eb824d768a9bd46941e96b95bf, disabling compactions & flushes 2023-02-07 15:03:13,253 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. after waiting 0 ms 2023-02-07 15:03:13,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,253 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b90841eb824d768a9bd46941e96b95bf: Waiting for close lock at 1675782193253Disabling compacts and flushes for region at 1675782193253Disabling writes for close at 1675782193253Writing region close event to WAL at 1675782193253Closed at 1675782193253 2023-02-07 15:03:13,253 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing dbde7afb9ea91e7cd5e8b278733dbe5a, disabling compactions & flushes 2023-02-07 15:03:13,254 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,254 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,254 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. after waiting 0 ms 2023-02-07 15:03:13,254 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,254 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,254 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for dbde7afb9ea91e7cd5e8b278733dbe5a: Waiting for close lock at 1675782193253Disabling compacts and flushes for region at 1675782193253Disabling writes for close at 1675782193254 (+1 ms)Writing region close event to WAL at 1675782193254Closed at 1675782193254 2023-02-07 15:03:13,254 INFO [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675782189368 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:13,254 DEBUG [Listener at localhost/45505] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,254 DEBUG [Listener at localhost/45505] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49 2023-02-07 15:03:13,255 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-data/ 2023-02-07 15:03:13,255 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----default/ 2023-02-07 15:03:13,256 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 15:03:13,256 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------4515ba2af0acbc3524e578aa3b6e31f1/ 2023-02-07 15:03:13,257 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,257 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,257 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=4515ba2af0acbc3524e578aa3b6e31f1-29e132e4d7754c259e0b7b7b2fb2851d 2023-02-07 15:03:13,258 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,258 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=4515ba2af0acbc3524e578aa3b6e31f1-9ffa44d1a6cd4e07a14fad725becccd4 2023-02-07 15:03:13,258 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------5809147126b1d00a96d9149aede55c62/ 2023-02-07 15:03:13,258 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,258 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,259 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=5809147126b1d00a96d9149aede55c62-39603cce918d4b9bb5371ca08cb70f2b 2023-02-07 15:03:13,259 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,259 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=5809147126b1d00a96d9149aede55c62-e968d21eadbe4704a249da3e6ab057cd 2023-02-07 15:03:13,259 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------77764c0223c4c5a67e1df0e8dc611ac7/ 2023-02-07 15:03:13,259 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,259 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,260 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=77764c0223c4c5a67e1df0e8dc611ac7-2fcc930802de481c871e2a0e442a6976 2023-02-07 15:03:13,260 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,260 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=77764c0223c4c5a67e1df0e8dc611ac7-a31c49135be94401aeec71151a77b7c6 2023-02-07 15:03:13,260 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------79871bca5cdc3f41385c7b09cd0f3639/ 2023-02-07 15:03:13,261 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,261 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,261 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=79871bca5cdc3f41385c7b09cd0f3639-88d98f980a774fb18f28f52731d5c09a 2023-02-07 15:03:13,261 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,262 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=79871bca5cdc3f41385c7b09cd0f3639-ee48850056434859a3a08a51129d2924 2023-02-07 15:03:13,262 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------8c0e0fe141e2d74cb3e983941db863a1/ 2023-02-07 15:03:13,262 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,262 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------b90841eb824d768a9bd46941e96b95bf/ 2023-02-07 15:03:13,262 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,263 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------bfb63f50c3843ca8196811d685109aef/ 2023-02-07 15:03:13,263 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,263 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,264 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=bfb63f50c3843ca8196811d685109aef-6217c9590c1a47c79535b1697f4c8fdb 2023-02-07 15:03:13,264 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,264 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=bfb63f50c3843ca8196811d685109aef-2dc3ee1d753140a7865b39e2be9211c0 2023-02-07 15:03:13,264 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------d7d946692158ddfbfd3bb655e3c71360/ 2023-02-07 15:03:13,265 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,265 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,265 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=d7d946692158ddfbfd3bb655e3c71360-a0ddf5c025544ceb9335c447888d7f6b 2023-02-07 15:03:13,265 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,266 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=d7d946692158ddfbfd3bb655e3c71360-3ed8ae406cf249c2b3be3ab1cec0ce8b 2023-02-07 15:03:13,266 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------dbde7afb9ea91e7cd5e8b278733dbe5a/ 2023-02-07 15:03:13,266 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,266 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,267 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=dbde7afb9ea91e7cd5e8b278733dbe5a-a3f4c0fc727a41e8b0c41fe0fab34e85 2023-02-07 15:03:13,267 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,267 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=dbde7afb9ea91e7cd5e8b278733dbe5a-cdc9e085d3d64257b2dcdc7da108f431 2023-02-07 15:03:13,267 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |----------e1642859e19b6de8bf9bffe58462f20b/ 2023-02-07 15:03:13,268 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:13,268 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:13,268 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=e1642859e19b6de8bf9bffe58462f20b-43d60b74144a46669fcf31fe2535e797 2023-02-07 15:03:13,268 DEBUG [Listener at localhost/45505] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:13,269 DEBUG [Listener at localhost/45505] util.CommonFSUtils(702): |----------------testWithMapReduce=e1642859e19b6de8bf9bffe58462f20b-d7ca5be343c54fbb9ced96346fab7330 2023-02-07 15:03:13,269 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,270 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,270 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,270 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,271 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,271 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,271 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,339 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop-7416848015479620935.jar 2023-02-07 15:03:13,340 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,340 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,341 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,341 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,342 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,342 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,342 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 15:03:13,343 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 15:03:13,343 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 15:03:13,343 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 15:03:13,344 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 15:03:13,344 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 15:03:13,345 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 15:03:13,345 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 15:03:13,345 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 15:03:13,346 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 15:03:13,346 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:13,346 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:13,347 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:13,347 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:13,347 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 15:03:13,414 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop-916190385626977164.jar 2023-02-07 15:03:13,415 DEBUG [Listener at localhost/45505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 15:03:13,420 WARN [Listener at localhost/45505] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 15:03:13,451 INFO [Listener at localhost/45505] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 15:03:13,550 WARN [Listener at localhost/45505] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/mapreduce.cluster.local.dir/1675782193517/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 15:03:13,550 WARN [Listener at localhost/45505] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/mapreduce.cluster.local.dir/1675782193517/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 15:03:13,585 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,586 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,587 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,589 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:13,590 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1 2023-02-07 15:03:13,591 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7d946692158ddfbfd3bb655e3c71360 columnFamilyName f1 2023-02-07 15:03:13,597 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f1/testWithMapReduce=d7d946692158ddfbfd3bb655e3c71360-a0ddf5c025544ceb9335c447888d7f6b 2023-02-07 15:03:13,597 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(310): Store=d7d946692158ddfbfd3bb655e3c71360/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,597 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7d946692158ddfbfd3bb655e3c71360 2023-02-07 15:03:13,598 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2 2023-02-07 15:03:13,599 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7d946692158ddfbfd3bb655e3c71360 columnFamilyName f2 2023-02-07 15:03:13,604 DEBUG [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/d7d946692158ddfbfd3bb655e3c71360/f2/testWithMapReduce=d7d946692158ddfbfd3bb655e3c71360-3ed8ae406cf249c2b3be3ab1cec0ce8b 2023-02-07 15:03:13,604 INFO [StoreOpener-d7d946692158ddfbfd3bb655e3c71360-1] regionserver.HStore(310): Store=d7d946692158ddfbfd3bb655e3c71360/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,604 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d7d946692158ddfbfd3bb655e3c71360; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63615490, jitterRate=-0.05205532908439636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d7d946692158ddfbfd3bb655e3c71360: Writing region info on filesystem at 1675782193587Initializing all the Stores at 1675782193588 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193588Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193588Region opened successfully at 1675782193604 (+16 ms) 2023-02-07 15:03:13,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d7d946692158ddfbfd3bb655e3c71360, disabling compactions & flushes 2023-02-07 15:03:13,636 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. after waiting 0 ms 2023-02-07 15:03:13,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,641 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675782187968.d7d946692158ddfbfd3bb655e3c71360. 2023-02-07 15:03:13,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d7d946692158ddfbfd3bb655e3c71360: Waiting for close lock at 1675782193635Disabling compacts and flushes for region at 1675782193635Disabling writes for close at 1675782193636 (+1 ms)Writing region close event to WAL at 1675782193641 (+5 ms)Closed at 1675782193641 2023-02-07 15:03:13,646 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,646 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,651 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,655 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:13,657 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1 2023-02-07 15:03:13,657 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4515ba2af0acbc3524e578aa3b6e31f1 columnFamilyName f1 2023-02-07 15:03:13,664 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f1/testWithMapReduce=4515ba2af0acbc3524e578aa3b6e31f1-29e132e4d7754c259e0b7b7b2fb2851d 2023-02-07 15:03:13,664 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(310): Store=4515ba2af0acbc3524e578aa3b6e31f1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,664 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4515ba2af0acbc3524e578aa3b6e31f1 2023-02-07 15:03:13,665 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2 2023-02-07 15:03:13,665 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4515ba2af0acbc3524e578aa3b6e31f1 columnFamilyName f2 2023-02-07 15:03:13,670 DEBUG [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/4515ba2af0acbc3524e578aa3b6e31f1/f2/testWithMapReduce=4515ba2af0acbc3524e578aa3b6e31f1-9ffa44d1a6cd4e07a14fad725becccd4 2023-02-07 15:03:13,670 INFO [StoreOpener-4515ba2af0acbc3524e578aa3b6e31f1-1] regionserver.HStore(310): Store=4515ba2af0acbc3524e578aa3b6e31f1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,670 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,671 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4515ba2af0acbc3524e578aa3b6e31f1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66961668, jitterRate=-0.0021933913230895996}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,671 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4515ba2af0acbc3524e578aa3b6e31f1: Writing region info on filesystem at 1675782193651Initializing all the Stores at 1675782193653 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193653Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193655 (+2 ms)Region opened successfully at 1675782193671 (+16 ms) 2023-02-07 15:03:13,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4515ba2af0acbc3524e578aa3b6e31f1, disabling compactions & flushes 2023-02-07 15:03:13,706 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. after waiting 0 ms 2023-02-07 15:03:13,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,707 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675782187968.4515ba2af0acbc3524e578aa3b6e31f1. 2023-02-07 15:03:13,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4515ba2af0acbc3524e578aa3b6e31f1: Waiting for close lock at 1675782193705Disabling compacts and flushes for region at 1675782193705Disabling writes for close at 1675782193706 (+1 ms)Writing region close event to WAL at 1675782193707 (+1 ms)Closed at 1675782193707 2023-02-07 15:03:13,712 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,712 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,713 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,714 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:13,715 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1 2023-02-07 15:03:13,716 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfb63f50c3843ca8196811d685109aef columnFamilyName f1 2023-02-07 15:03:13,724 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f1/testWithMapReduce=bfb63f50c3843ca8196811d685109aef-6217c9590c1a47c79535b1697f4c8fdb 2023-02-07 15:03:13,724 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(310): Store=bfb63f50c3843ca8196811d685109aef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,724 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfb63f50c3843ca8196811d685109aef 2023-02-07 15:03:13,725 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2 2023-02-07 15:03:13,725 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfb63f50c3843ca8196811d685109aef columnFamilyName f2 2023-02-07 15:03:13,730 DEBUG [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/bfb63f50c3843ca8196811d685109aef/f2/testWithMapReduce=bfb63f50c3843ca8196811d685109aef-2dc3ee1d753140a7865b39e2be9211c0 2023-02-07 15:03:13,730 INFO [StoreOpener-bfb63f50c3843ca8196811d685109aef-1] regionserver.HStore(310): Store=bfb63f50c3843ca8196811d685109aef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,731 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bfb63f50c3843ca8196811d685109aef; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64437982, jitterRate=-0.039799243211746216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bfb63f50c3843ca8196811d685109aef: Writing region info on filesystem at 1675782193713Initializing all the Stores at 1675782193714 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193714Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193714Region opened successfully at 1675782193731 (+17 ms) 2023-02-07 15:03:13,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bfb63f50c3843ca8196811d685109aef, disabling compactions & flushes 2023-02-07 15:03:13,770 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. after waiting 0 ms 2023-02-07 15:03:13,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,771 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675782187968.bfb63f50c3843ca8196811d685109aef. 2023-02-07 15:03:13,771 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bfb63f50c3843ca8196811d685109aef: Waiting for close lock at 1675782193770Disabling compacts and flushes for region at 1675782193770Disabling writes for close at 1675782193770Writing region close event to WAL at 1675782193771 (+1 ms)Closed at 1675782193771 2023-02-07 15:03:13,775 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,775 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,776 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,778 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:13,779 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1 2023-02-07 15:03:13,779 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5809147126b1d00a96d9149aede55c62 columnFamilyName f1 2023-02-07 15:03:13,784 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f1/testWithMapReduce=5809147126b1d00a96d9149aede55c62-39603cce918d4b9bb5371ca08cb70f2b 2023-02-07 15:03:13,784 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(310): Store=5809147126b1d00a96d9149aede55c62/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,784 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5809147126b1d00a96d9149aede55c62 2023-02-07 15:03:13,785 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2 2023-02-07 15:03:13,786 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5809147126b1d00a96d9149aede55c62 columnFamilyName f2 2023-02-07 15:03:13,790 DEBUG [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/5809147126b1d00a96d9149aede55c62/f2/testWithMapReduce=5809147126b1d00a96d9149aede55c62-e968d21eadbe4704a249da3e6ab057cd 2023-02-07 15:03:13,790 INFO [StoreOpener-5809147126b1d00a96d9149aede55c62-1] regionserver.HStore(310): Store=5809147126b1d00a96d9149aede55c62/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,790 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,790 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5809147126b1d00a96d9149aede55c62; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61966651, jitterRate=-0.07662494480609894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,790 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5809147126b1d00a96d9149aede55c62: Writing region info on filesystem at 1675782193776Initializing all the Stores at 1675782193777 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193777Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193777Region opened successfully at 1675782193790 (+13 ms) 2023-02-07 15:03:13,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5809147126b1d00a96d9149aede55c62, disabling compactions & flushes 2023-02-07 15:03:13,818 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. after waiting 0 ms 2023-02-07 15:03:13,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,819 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675782187968.5809147126b1d00a96d9149aede55c62. 2023-02-07 15:03:13,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5809147126b1d00a96d9149aede55c62: Waiting for close lock at 1675782193817Disabling compacts and flushes for region at 1675782193817Disabling writes for close at 1675782193818 (+1 ms)Writing region close event to WAL at 1675782193819 (+1 ms)Closed at 1675782193819 2023-02-07 15:03:13,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,823 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,824 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,829 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:13,829 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1 2023-02-07 15:03:13,830 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77764c0223c4c5a67e1df0e8dc611ac7 columnFamilyName f1 2023-02-07 15:03:13,835 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f1/testWithMapReduce=77764c0223c4c5a67e1df0e8dc611ac7-2fcc930802de481c871e2a0e442a6976 2023-02-07 15:03:13,835 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(310): Store=77764c0223c4c5a67e1df0e8dc611ac7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,835 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77764c0223c4c5a67e1df0e8dc611ac7 2023-02-07 15:03:13,836 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2 2023-02-07 15:03:13,836 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77764c0223c4c5a67e1df0e8dc611ac7 columnFamilyName f2 2023-02-07 15:03:13,841 DEBUG [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/77764c0223c4c5a67e1df0e8dc611ac7/f2/testWithMapReduce=77764c0223c4c5a67e1df0e8dc611ac7-a31c49135be94401aeec71151a77b7c6 2023-02-07 15:03:13,842 INFO [StoreOpener-77764c0223c4c5a67e1df0e8dc611ac7-1] regionserver.HStore(310): Store=77764c0223c4c5a67e1df0e8dc611ac7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,842 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 77764c0223c4c5a67e1df0e8dc611ac7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59145361, jitterRate=-0.11866544187068939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 77764c0223c4c5a67e1df0e8dc611ac7: Writing region info on filesystem at 1675782193824Initializing all the Stores at 1675782193825 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193825Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193828 (+3 ms)Region opened successfully at 1675782193842 (+14 ms) 2023-02-07 15:03:13,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 77764c0223c4c5a67e1df0e8dc611ac7, disabling compactions & flushes 2023-02-07 15:03:13,869 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. after waiting 0 ms 2023-02-07 15:03:13,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,870 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675782187968.77764c0223c4c5a67e1df0e8dc611ac7. 2023-02-07 15:03:13,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 77764c0223c4c5a67e1df0e8dc611ac7: Waiting for close lock at 1675782193869Disabling compacts and flushes for region at 1675782193869Disabling writes for close at 1675782193870 (+1 ms)Writing region close event to WAL at 1675782193870Closed at 1675782193870 2023-02-07 15:03:13,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,875 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,877 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,881 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:13,882 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1 2023-02-07 15:03:13,882 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbde7afb9ea91e7cd5e8b278733dbe5a columnFamilyName f1 2023-02-07 15:03:13,888 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f1/testWithMapReduce=dbde7afb9ea91e7cd5e8b278733dbe5a-a3f4c0fc727a41e8b0c41fe0fab34e85 2023-02-07 15:03:13,888 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(310): Store=dbde7afb9ea91e7cd5e8b278733dbe5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,888 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dbde7afb9ea91e7cd5e8b278733dbe5a 2023-02-07 15:03:13,889 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2 2023-02-07 15:03:13,889 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbde7afb9ea91e7cd5e8b278733dbe5a columnFamilyName f2 2023-02-07 15:03:13,894 DEBUG [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/dbde7afb9ea91e7cd5e8b278733dbe5a/f2/testWithMapReduce=dbde7afb9ea91e7cd5e8b278733dbe5a-cdc9e085d3d64257b2dcdc7da108f431 2023-02-07 15:03:13,895 INFO [StoreOpener-dbde7afb9ea91e7cd5e8b278733dbe5a-1] regionserver.HStore(310): Store=dbde7afb9ea91e7cd5e8b278733dbe5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,895 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dbde7afb9ea91e7cd5e8b278733dbe5a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66763994, jitterRate=-0.005138963460922241}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dbde7afb9ea91e7cd5e8b278733dbe5a: Writing region info on filesystem at 1675782193878Initializing all the Stores at 1675782193879 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193879Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193880 (+1 ms)Region opened successfully at 1675782193895 (+15 ms) 2023-02-07 15:03:13,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dbde7afb9ea91e7cd5e8b278733dbe5a, disabling compactions & flushes 2023-02-07 15:03:13,925 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. after waiting 0 ms 2023-02-07 15:03:13,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,926 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675782187968.dbde7afb9ea91e7cd5e8b278733dbe5a. 2023-02-07 15:03:13,926 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dbde7afb9ea91e7cd5e8b278733dbe5a: Waiting for close lock at 1675782193925Disabling compacts and flushes for region at 1675782193925Disabling writes for close at 1675782193925Writing region close event to WAL at 1675782193926 (+1 ms)Closed at 1675782193926 2023-02-07 15:03:13,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,930 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,931 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,933 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:13,934 DEBUG [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/f1 2023-02-07 15:03:13,935 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90841eb824d768a9bd46941e96b95bf columnFamilyName f1 2023-02-07 15:03:13,936 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(310): Store=b90841eb824d768a9bd46941e96b95bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,936 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b90841eb824d768a9bd46941e96b95bf 2023-02-07 15:03:13,937 DEBUG [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/b90841eb824d768a9bd46941e96b95bf/f2 2023-02-07 15:03:13,937 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90841eb824d768a9bd46941e96b95bf columnFamilyName f2 2023-02-07 15:03:13,938 INFO [StoreOpener-b90841eb824d768a9bd46941e96b95bf-1] regionserver.HStore(310): Store=b90841eb824d768a9bd46941e96b95bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,938 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,938 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b90841eb824d768a9bd46941e96b95bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74850257, jitterRate=0.11535574495792389}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,938 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b90841eb824d768a9bd46941e96b95bf: Writing region info on filesystem at 1675782193931Initializing all the Stores at 1675782193932 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193932Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193932Region opened successfully at 1675782193938 (+6 ms) 2023-02-07 15:03:13,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b90841eb824d768a9bd46941e96b95bf, disabling compactions & flushes 2023-02-07 15:03:13,964 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. after waiting 0 ms 2023-02-07 15:03:13,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,964 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675782187968.b90841eb824d768a9bd46941e96b95bf. 2023-02-07 15:03:13,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b90841eb824d768a9bd46941e96b95bf: Waiting for close lock at 1675782193964Disabling compacts and flushes for region at 1675782193964Disabling writes for close at 1675782193964Writing region close event to WAL at 1675782193964Closed at 1675782193964 2023-02-07 15:03:13,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:13,967 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:13,968 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:13,970 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:13,971 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1 2023-02-07 15:03:13,971 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79871bca5cdc3f41385c7b09cd0f3639 columnFamilyName f1 2023-02-07 15:03:13,977 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f1/testWithMapReduce=79871bca5cdc3f41385c7b09cd0f3639-88d98f980a774fb18f28f52731d5c09a 2023-02-07 15:03:13,977 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(310): Store=79871bca5cdc3f41385c7b09cd0f3639/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,977 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 79871bca5cdc3f41385c7b09cd0f3639 2023-02-07 15:03:13,978 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2 2023-02-07 15:03:13,979 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79871bca5cdc3f41385c7b09cd0f3639 columnFamilyName f2 2023-02-07 15:03:13,980 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 15:03:13,989 DEBUG [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/79871bca5cdc3f41385c7b09cd0f3639/f2/testWithMapReduce=79871bca5cdc3f41385c7b09cd0f3639-ee48850056434859a3a08a51129d2924 2023-02-07 15:03:13,989 INFO [StoreOpener-79871bca5cdc3f41385c7b09cd0f3639-1] regionserver.HStore(310): Store=79871bca5cdc3f41385c7b09cd0f3639/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:13,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:13,989 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 79871bca5cdc3f41385c7b09cd0f3639; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60913654, jitterRate=-0.09231582283973694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:13,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 79871bca5cdc3f41385c7b09cd0f3639: Writing region info on filesystem at 1675782193968Initializing all the Stores at 1675782193969 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193969Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782193969Region opened successfully at 1675782193989 (+20 ms) 2023-02-07 15:03:14,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 79871bca5cdc3f41385c7b09cd0f3639, disabling compactions & flushes 2023-02-07 15:03:14,032 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:14,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:14,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. after waiting 0 ms 2023-02-07 15:03:14,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:14,038 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675782187968.79871bca5cdc3f41385c7b09cd0f3639. 2023-02-07 15:03:14,038 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 79871bca5cdc3f41385c7b09cd0f3639: Waiting for close lock at 1675782194032Disabling compacts and flushes for region at 1675782194032Disabling writes for close at 1675782194032Writing region close event to WAL at 1675782194038 (+6 ms)Closed at 1675782194038 2023-02-07 15:03:14,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:14,042 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:14,043 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:14,049 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:14,050 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1 2023-02-07 15:03:14,050 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1642859e19b6de8bf9bffe58462f20b columnFamilyName f1 2023-02-07 15:03:14,055 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f1/testWithMapReduce=e1642859e19b6de8bf9bffe58462f20b-43d60b74144a46669fcf31fe2535e797 2023-02-07 15:03:14,055 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(310): Store=e1642859e19b6de8bf9bffe58462f20b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:14,055 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1642859e19b6de8bf9bffe58462f20b 2023-02-07 15:03:14,056 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2 2023-02-07 15:03:14,056 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1642859e19b6de8bf9bffe58462f20b columnFamilyName f2 2023-02-07 15:03:14,061 DEBUG [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(539): loaded hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/e1642859e19b6de8bf9bffe58462f20b/f2/testWithMapReduce=e1642859e19b6de8bf9bffe58462f20b-d7ca5be343c54fbb9ced96346fab7330 2023-02-07 15:03:14,061 INFO [StoreOpener-e1642859e19b6de8bf9bffe58462f20b-1] regionserver.HStore(310): Store=e1642859e19b6de8bf9bffe58462f20b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:14,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:14,062 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e1642859e19b6de8bf9bffe58462f20b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60560186, jitterRate=-0.09758290648460388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:14,062 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e1642859e19b6de8bf9bffe58462f20b: Writing region info on filesystem at 1675782194043Initializing all the Stores at 1675782194044 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782194044Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782194048 (+4 ms)Region opened successfully at 1675782194062 (+14 ms) 2023-02-07 15:03:14,088 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e1642859e19b6de8bf9bffe58462f20b, disabling compactions & flushes 2023-02-07 15:03:14,089 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:14,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:14,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. after waiting 0 ms 2023-02-07 15:03:14,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:14,089 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675782187968.e1642859e19b6de8bf9bffe58462f20b. 2023-02-07 15:03:14,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e1642859e19b6de8bf9bffe58462f20b: Waiting for close lock at 1675782194088Disabling compacts and flushes for region at 1675782194088Disabling writes for close at 1675782194089 (+1 ms)Writing region close event to WAL at 1675782194089Closed at 1675782194089 2023-02-07 15:03:14,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:14,093 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:14,095 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:14,097 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:14,099 DEBUG [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/f1 2023-02-07 15:03:14,099 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0e0fe141e2d74cb3e983941db863a1 columnFamilyName f1 2023-02-07 15:03:14,100 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(310): Store=8c0e0fe141e2d74cb3e983941db863a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:14,100 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8c0e0fe141e2d74cb3e983941db863a1 2023-02-07 15:03:14,102 DEBUG [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46571/user/jenkins/test-data/151546c7-cd97-5a63-5a60-6cced1dc8f5a/testWithMapReduceAndOfflineHBaseMultiRegion/fe69a344-adfb-42ec-8d2e-cff4fb6b5b49/data/default/testWithMapReduce/8c0e0fe141e2d74cb3e983941db863a1/f2 2023-02-07 15:03:14,102 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0e0fe141e2d74cb3e983941db863a1 columnFamilyName f2 2023-02-07 15:03:14,103 INFO [StoreOpener-8c0e0fe141e2d74cb3e983941db863a1-1] regionserver.HStore(310): Store=8c0e0fe141e2d74cb3e983941db863a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:14,103 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:14,103 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8c0e0fe141e2d74cb3e983941db863a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64991266, jitterRate=-0.03155466914176941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:14,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8c0e0fe141e2d74cb3e983941db863a1: Writing region info on filesystem at 1675782194095Initializing all the Stores at 1675782194096 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782194096Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782194096Region opened successfully at 1675782194103 (+7 ms) 2023-02-07 15:03:14,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8c0e0fe141e2d74cb3e983941db863a1, disabling compactions & flushes 2023-02-07 15:03:14,123 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:14,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:14,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. after waiting 0 ms 2023-02-07 15:03:14,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:14,124 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782187968.8c0e0fe141e2d74cb3e983941db863a1. 2023-02-07 15:03:14,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8c0e0fe141e2d74cb3e983941db863a1: Waiting for close lock at 1675782194123Disabling compacts and flushes for region at 1675782194123Disabling writes for close at 1675782194123Writing region close event to WAL at 1675782194124 (+1 ms)Closed at 1675782194124 2023-02-07 15:03:14,585 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 15:03:14,586 WARN [Listener at localhost/45505] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:14,588 INFO [Listener at localhost/45505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:14,691 WARN [BP-316757895-172.31.14.131-1675782185372 heartbeating to localhost/127.0.0.1:46571] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:14,692 WARN [BP-316757895-172.31.14.131-1675782185372 heartbeating to localhost/127.0.0.1:46571] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-316757895-172.31.14.131-1675782185372 (Datanode Uuid 6bd346d7-ee65-4d5e-9b29-e8a5083bdf63) service to localhost/127.0.0.1:46571 2023-02-07 15:03:14,693 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89/dfs/data/data3/current/BP-316757895-172.31.14.131-1675782185372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:14,693 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89/dfs/data/data4/current/BP-316757895-172.31.14.131-1675782185372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:14,694 WARN [Listener at localhost/45505] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:14,701 INFO [Listener at localhost/45505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:14,805 WARN [BP-316757895-172.31.14.131-1675782185372 heartbeating to localhost/127.0.0.1:46571] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:14,806 WARN [BP-316757895-172.31.14.131-1675782185372 heartbeating to localhost/127.0.0.1:46571] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-316757895-172.31.14.131-1675782185372 (Datanode Uuid cb353994-c98d-4148-8751-bfbba05db11b) service to localhost/127.0.0.1:46571 2023-02-07 15:03:14,807 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89/dfs/data/data1/current/BP-316757895-172.31.14.131-1675782185372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:14,807 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/cluster_0f2662ca-a8f3-2f99-6e1b-1cf154d86c89/dfs/data/data2/current/BP-316757895-172.31.14.131-1675782185372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:14,819 INFO [Listener at localhost/45505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:14,939 INFO [Listener at localhost/45505] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 15:03:14,981 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 15:03:14,994 INFO [Listener at localhost/45505] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 103) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45505 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46571 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46571 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36585,1675782186118)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:46571 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:46571 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46571 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46571 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46571 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=535 (was 541), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 356), ProcessCount=166 (was 166), AvailableMemoryMB=5676 (was 5840) 2023-02-07 15:03:15,004 INFO [Listener at localhost/45505] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=166, AvailableMemoryMB=5675 2023-02-07 15:03:15,014 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop.log.dir so I do NOT create it in target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f 2023-02-07 15:03:15,014 WARN [Listener at localhost/45505] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 15:03:15,014 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop.tmp.dir so I do NOT create it in target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f 2023-02-07 15:03:15,014 WARN [Listener at localhost/45505] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/920d61d0-9c83-6b93-c092-312124c9408c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 15:03:15,014 DEBUG [Listener at localhost/45505] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85, deleteOnExit=true 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/test.cache.data in system properties and HBase conf 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/hadoop.log.dir in system properties and HBase conf 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 15:03:15,015 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 15:03:15,015 DEBUG [Listener at localhost/45505] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 15:03:15,016 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:15,016 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:15,016 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 15:03:15,016 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:15,016 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 15:03:15,016 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 15:03:15,016 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:15,017 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:15,017 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 15:03:15,017 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/nfs.dump.dir in system properties and HBase conf 2023-02-07 15:03:15,017 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/java.io.tmpdir in system properties and HBase conf 2023-02-07 15:03:15,017 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:15,017 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 15:03:15,017 INFO [Listener at localhost/45505] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 15:03:15,021 WARN [Listener at localhost/45505] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:15,021 WARN [Listener at localhost/45505] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:15,063 WARN [Listener at localhost/45505] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:15,065 INFO [Listener at localhost/45505] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:15,069 INFO [Listener at localhost/45505] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/java.io.tmpdir/Jetty_localhost_33169_hdfs____losh6m/webapp 2023-02-07 15:03:15,161 INFO [Listener at localhost/45505] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33169 2023-02-07 15:03:15,165 WARN [Listener at localhost/45505] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:15,165 WARN [Listener at localhost/45505] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:15,203 WARN [Listener at localhost/33975] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:15,216 WARN [Listener at localhost/33975] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:15,220 WARN [Listener at localhost/33975] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:15,221 INFO [Listener at localhost/33975] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:15,228 INFO [Listener at localhost/33975] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/java.io.tmpdir/Jetty_localhost_40929_datanode____z2nwa3/webapp 2023-02-07 15:03:15,321 INFO [Listener at localhost/33975] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40929 2023-02-07 15:03:15,329 WARN [Listener at localhost/37759] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:15,342 WARN [Listener at localhost/37759] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:15,344 WARN [Listener at localhost/37759] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:15,345 INFO [Listener at localhost/37759] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:15,349 INFO [Listener at localhost/37759] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/java.io.tmpdir/Jetty_localhost_45491_datanode____.9g6wdq/webapp 2023-02-07 15:03:15,421 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6147038523a86309: Processing first storage report for DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b from datanode e80a3450-2806-461f-9b9f-0390f4537072 2023-02-07 15:03:15,421 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6147038523a86309: from storage DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b node DatanodeRegistration(127.0.0.1:45911, datanodeUuid=e80a3450-2806-461f-9b9f-0390f4537072, infoPort=41565, infoSecurePort=0, ipcPort=37759, storageInfo=lv=-57;cid=testClusterID;nsid=1664646463;c=1675782195024), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:15,421 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6147038523a86309: Processing first storage report for DS-dbf6e570-853a-4336-b9d0-a14a42866938 from datanode e80a3450-2806-461f-9b9f-0390f4537072 2023-02-07 15:03:15,421 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6147038523a86309: from storage DS-dbf6e570-853a-4336-b9d0-a14a42866938 node DatanodeRegistration(127.0.0.1:45911, datanodeUuid=e80a3450-2806-461f-9b9f-0390f4537072, infoPort=41565, infoSecurePort=0, ipcPort=37759, storageInfo=lv=-57;cid=testClusterID;nsid=1664646463;c=1675782195024), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:15,459 INFO [Listener at localhost/37759] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45491 2023-02-07 15:03:15,466 WARN [Listener at localhost/39115] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:15,557 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x64c139d90b82c054: Processing first storage report for DS-f18adbc2-1948-46a7-8503-c169c5ff58e9 from datanode 9fdb9afa-3b01-4901-a195-df0c1290769d 2023-02-07 15:03:15,557 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x64c139d90b82c054: from storage DS-f18adbc2-1948-46a7-8503-c169c5ff58e9 node DatanodeRegistration(127.0.0.1:43387, datanodeUuid=9fdb9afa-3b01-4901-a195-df0c1290769d, infoPort=41849, infoSecurePort=0, ipcPort=39115, storageInfo=lv=-57;cid=testClusterID;nsid=1664646463;c=1675782195024), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:15,557 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x64c139d90b82c054: Processing first storage report for DS-428f072c-a28b-4010-bd42-a92cf688783b from datanode 9fdb9afa-3b01-4901-a195-df0c1290769d 2023-02-07 15:03:15,557 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x64c139d90b82c054: from storage DS-428f072c-a28b-4010-bd42-a92cf688783b node DatanodeRegistration(127.0.0.1:43387, datanodeUuid=9fdb9afa-3b01-4901-a195-df0c1290769d, infoPort=41849, infoSecurePort=0, ipcPort=39115, storageInfo=lv=-57;cid=testClusterID;nsid=1664646463;c=1675782195024), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:15,576 DEBUG [Listener at localhost/39115] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f 2023-02-07 15:03:15,578 INFO [Listener at localhost/39115] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85/zookeeper_0, clientPort=58414, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 15:03:15,579 INFO [Listener at localhost/39115] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58414 2023-02-07 15:03:15,579 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,580 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,592 INFO [Listener at localhost/39115] util.FSUtils(479): Created version file at hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d with version=8 2023-02-07 15:03:15,592 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,593 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,594 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33975/user/jenkins/test-data/bdd431af-e12a-95ed-d474-7d08bc49d667/hbase-staging 2023-02-07 15:03:15,596 INFO [Listener at localhost/39115] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:15,596 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,596 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,596 INFO [Listener at localhost/39115] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:15,596 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,596 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:15,597 INFO [Listener at localhost/39115] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:15,598 INFO [Listener at localhost/39115] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35177 2023-02-07 15:03:15,598 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,599 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,600 INFO [Listener at localhost/39115] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35177 connecting to ZooKeeper ensemble=127.0.0.1:58414 2023-02-07 15:03:15,605 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:351770x0, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:15,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35177-0x1002f4ef33e0000 connected 2023-02-07 15:03:15,626 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:15,626 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:15,627 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:15,632 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35177 2023-02-07 15:03:15,632 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35177 2023-02-07 15:03:15,632 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35177 2023-02-07 15:03:15,633 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35177 2023-02-07 15:03:15,633 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35177 2023-02-07 15:03:15,633 INFO [Listener at localhost/39115] master.HMaster(439): hbase.rootdir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d, hbase.cluster.distributed=false 2023-02-07 15:03:15,645 INFO [Listener at localhost/39115] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:15,645 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,645 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,646 INFO [Listener at localhost/39115] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:15,646 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,646 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:15,646 INFO [Listener at localhost/39115] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:15,649 INFO [Listener at localhost/39115] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40387 2023-02-07 15:03:15,649 INFO [Listener at localhost/39115] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:15,650 DEBUG [Listener at localhost/39115] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:15,651 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,652 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,653 INFO [Listener at localhost/39115] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40387 connecting to ZooKeeper ensemble=127.0.0.1:58414 2023-02-07 15:03:15,656 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:403870x0, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:15,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40387-0x1002f4ef33e0001 connected 2023-02-07 15:03:15,659 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:15,659 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:15,660 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:15,664 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40387 2023-02-07 15:03:15,668 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40387 2023-02-07 15:03:15,668 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40387 2023-02-07 15:03:15,671 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40387 2023-02-07 15:03:15,671 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40387 2023-02-07 15:03:15,682 INFO [Listener at localhost/39115] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:15,682 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,682 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,682 INFO [Listener at localhost/39115] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:15,682 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:15,682 INFO [Listener at localhost/39115] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:15,682 INFO [Listener at localhost/39115] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:15,685 INFO [Listener at localhost/39115] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40297 2023-02-07 15:03:15,685 INFO [Listener at localhost/39115] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:15,686 DEBUG [Listener at localhost/39115] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:15,686 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,687 INFO [Listener at localhost/39115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,688 INFO [Listener at localhost/39115] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40297 connecting to ZooKeeper ensemble=127.0.0.1:58414 2023-02-07 15:03:15,692 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:402970x0, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:15,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40297-0x1002f4ef33e0002 connected 2023-02-07 15:03:15,694 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:15,695 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:15,695 DEBUG [Listener at localhost/39115] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:15,696 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40297 2023-02-07 15:03:15,696 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40297 2023-02-07 15:03:15,697 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40297 2023-02-07 15:03:15,700 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40297 2023-02-07 15:03:15,700 DEBUG [Listener at localhost/39115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40297 2023-02-07 15:03:15,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:15,703 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:15,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:15,704 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:15,704 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:15,704 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:15,705 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:15,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:15,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35177,1675782195595 from backup master directory 2023-02-07 15:03:15,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:15,707 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:15,707 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:15,707 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:15,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:15,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/hbase.id with ID: cf187024-7734-434c-8853-0352d9074a9d 2023-02-07 15:03:15,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:15,741 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:15,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x68edc2c1 to 127.0.0.1:58414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:15,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d4bb89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:15,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 15:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:15,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store-tmp 2023-02-07 15:03:15,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:15,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:15,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:15,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:15,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:15,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:15,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:15,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782195768Disabling compacts and flushes for region at 1675782195768Disabling writes for close at 1675782195768Writing region close event to WAL at 1675782195768Closed at 1675782195768 2023-02-07 15:03:15,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/WALs/jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:15,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35177%2C1675782195595, suffix=, logDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/WALs/jenkins-hbase4.apache.org,35177,1675782195595, archiveDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/oldWALs, maxLogs=10 2023-02-07 15:03:15,788 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK] 2023-02-07 15:03:15,788 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK] 2023-02-07 15:03:15,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/WALs/jenkins-hbase4.apache.org,35177,1675782195595/jenkins-hbase4.apache.org%2C35177%2C1675782195595.1675782195772 2023-02-07 15:03:15,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK], DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK]] 2023-02-07 15:03:15,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:15,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:15,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:15,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:15,792 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:15,793 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 15:03:15,794 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 15:03:15,794 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:15,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:15,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:15,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:15,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:15,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66903671, jitterRate=-0.003057613968849182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:15,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675782195791Initializing all the Stores at 1675782195792 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782195792Cleaning up temporary data from old regions at 1675782195795 (+3 ms)Cleaning up detritus from prior splits at 1675782195796 (+1 ms)Region opened successfully at 1675782195800 (+4 ms) 2023-02-07 15:03:15,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 15:03:15,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 15:03:15,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 15:03:15,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 15:03:15,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 15:03:15,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 15:03:15,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 15:03:15,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 15:03:15,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 15:03:15,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 15:03:15,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 15:03:15,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 15:03:15,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 15:03:15,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 15:03:15,820 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:15,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 15:03:15,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 15:03:15,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 15:03:15,823 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:15,823 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:15,823 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:15,823 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:15,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35177,1675782195595, sessionid=0x1002f4ef33e0000, setting cluster-up flag (Was=false) 2023-02-07 15:03:15,828 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:15,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 15:03:15,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:15,835 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:15,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 15:03:15,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:15,841 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.hbase-snapshot/.tmp 2023-02-07 15:03:15,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:15,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:15,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:15,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:15,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:15,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 15:03:15,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:15,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675782225844 2023-02-07 15:03:15,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 15:03:15,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 15:03:15,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 15:03:15,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 15:03:15,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 15:03:15,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 15:03:15,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,846 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:15,846 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 15:03:15,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 15:03:15,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 15:03:15,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 15:03:15,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 15:03:15,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 15:03:15,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782195847,5,FailOnTimeoutGroup] 2023-02-07 15:03:15,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782195848,5,FailOnTimeoutGroup] 2023-02-07 15:03:15,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 15:03:15,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,848 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:15,856 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:15,857 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:15,857 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d 2023-02-07 15:03:15,867 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:15,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:15,869 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/info 2023-02-07 15:03:15,870 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:15,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:15,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:15,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:15,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:15,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:15,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:15,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/table 2023-02-07 15:03:15,873 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:15,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:15,874 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740 2023-02-07 15:03:15,874 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740 2023-02-07 15:03:15,876 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:15,877 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:15,878 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:15,879 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66828990, jitterRate=-0.004170447587966919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:15,879 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675782195867Initializing all the Stores at 1675782195868 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782195868Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782195868Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782195868Cleaning up temporary data from old regions at 1675782195875 (+7 ms)Cleaning up detritus from prior splits at 1675782195875Region opened successfully at 1675782195879 (+4 ms) 2023-02-07 15:03:15,879 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:15,879 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:15,879 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:15,879 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:15,879 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:15,879 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:15,879 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782195879Disabling compacts and flushes for region at 1675782195879Disabling writes for close at 1675782195879Writing region close event to WAL at 1675782195879Closed at 1675782195879 2023-02-07 15:03:15,880 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:15,880 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 15:03:15,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 15:03:15,882 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 15:03:15,883 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 15:03:15,902 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(952): ClusterId : cf187024-7734-434c-8853-0352d9074a9d 2023-02-07 15:03:15,902 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(952): ClusterId : cf187024-7734-434c-8853-0352d9074a9d 2023-02-07 15:03:15,902 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:15,902 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:15,904 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:15,904 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:15,904 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:15,904 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:15,907 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:15,908 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:15,908 DEBUG [RS:1;jenkins-hbase4:40297] zookeeper.ReadOnlyZKClient(139): Connect 0x63edc502 to 127.0.0.1:58414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:15,909 DEBUG [RS:0;jenkins-hbase4:40387] zookeeper.ReadOnlyZKClient(139): Connect 0x38b40dd5 to 127.0.0.1:58414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:15,919 DEBUG [RS:1;jenkins-hbase4:40297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d2a370f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:15,919 DEBUG [RS:0;jenkins-hbase4:40387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3673e4b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:15,919 DEBUG [RS:1;jenkins-hbase4:40297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6915ae72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:15,919 DEBUG [RS:0;jenkins-hbase4:40387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@324c66a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:15,928 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40387 2023-02-07 15:03:15,928 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40297 2023-02-07 15:03:15,928 INFO [RS:0;jenkins-hbase4:40387] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:15,928 INFO [RS:1;jenkins-hbase4:40297] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:15,928 INFO [RS:1;jenkins-hbase4:40297] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:15,928 INFO [RS:0;jenkins-hbase4:40387] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:15,928 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:15,928 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:15,929 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35177,1675782195595 with isa=jenkins-hbase4.apache.org/172.31.14.131:40297, startcode=1675782195681 2023-02-07 15:03:15,929 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35177,1675782195595 with isa=jenkins-hbase4.apache.org/172.31.14.131:40387, startcode=1675782195645 2023-02-07 15:03:15,929 DEBUG [RS:1;jenkins-hbase4:40297] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:15,929 DEBUG [RS:0;jenkins-hbase4:40387] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:15,931 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51009, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:15,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:15,932 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50097, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:15,933 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d 2023-02-07 15:03:15,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:15,933 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33975 2023-02-07 15:03:15,933 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:15,933 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d 2023-02-07 15:03:15,933 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33975 2023-02-07 15:03:15,933 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:15,934 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:15,939 DEBUG [RS:0;jenkins-hbase4:40387] zookeeper.ZKUtil(162): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:15,939 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40297,1675782195681] 2023-02-07 15:03:15,939 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40387,1675782195645] 2023-02-07 15:03:15,939 WARN [RS:0;jenkins-hbase4:40387] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:15,939 DEBUG [RS:1;jenkins-hbase4:40297] zookeeper.ZKUtil(162): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:15,939 INFO [RS:0;jenkins-hbase4:40387] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:15,939 WARN [RS:1;jenkins-hbase4:40297] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:15,939 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:15,939 INFO [RS:1;jenkins-hbase4:40297] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:15,939 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:15,945 DEBUG [RS:0;jenkins-hbase4:40387] zookeeper.ZKUtil(162): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:15,945 DEBUG [RS:1;jenkins-hbase4:40297] zookeeper.ZKUtil(162): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:15,945 DEBUG [RS:0;jenkins-hbase4:40387] zookeeper.ZKUtil(162): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:15,945 DEBUG [RS:1;jenkins-hbase4:40297] zookeeper.ZKUtil(162): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:15,946 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:15,946 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:15,946 INFO [RS:0;jenkins-hbase4:40387] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:15,946 INFO [RS:1;jenkins-hbase4:40297] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:15,947 INFO [RS:0;jenkins-hbase4:40387] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:15,948 INFO [RS:0;jenkins-hbase4:40387] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:15,948 INFO [RS:0;jenkins-hbase4:40387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,950 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:15,951 INFO [RS:1;jenkins-hbase4:40297] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:15,951 INFO [RS:1;jenkins-hbase4:40297] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:15,951 INFO [RS:1;jenkins-hbase4:40297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,952 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:15,952 INFO [RS:0;jenkins-hbase4:40387] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,952 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,952 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,952 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,952 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,952 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:15,953 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 INFO [RS:1;jenkins-hbase4:40297] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,953 DEBUG [RS:0;jenkins-hbase4:40387] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,953 DEBUG [RS:1;jenkins-hbase4:40297] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:15,957 INFO [RS:0;jenkins-hbase4:40387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,957 INFO [RS:0;jenkins-hbase4:40387] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,957 INFO [RS:0;jenkins-hbase4:40387] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,957 INFO [RS:1;jenkins-hbase4:40297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,957 INFO [RS:1;jenkins-hbase4:40297] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,957 INFO [RS:1;jenkins-hbase4:40297] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,968 INFO [RS:0;jenkins-hbase4:40387] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:15,968 INFO [RS:1;jenkins-hbase4:40297] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:15,968 INFO [RS:0;jenkins-hbase4:40387] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40387,1675782195645-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,968 INFO [RS:1;jenkins-hbase4:40297] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40297,1675782195681-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:15,980 INFO [RS:0;jenkins-hbase4:40387] regionserver.Replication(203): jenkins-hbase4.apache.org,40387,1675782195645 started 2023-02-07 15:03:15,980 INFO [RS:1;jenkins-hbase4:40297] regionserver.Replication(203): jenkins-hbase4.apache.org,40297,1675782195681 started 2023-02-07 15:03:15,980 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40387,1675782195645, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40387, sessionid=0x1002f4ef33e0001 2023-02-07 15:03:15,980 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40297,1675782195681, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40297, sessionid=0x1002f4ef33e0002 2023-02-07 15:03:15,980 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:15,980 DEBUG [RS:0;jenkins-hbase4:40387] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:15,980 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:15,980 DEBUG [RS:1;jenkins-hbase4:40297] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:15,980 DEBUG [RS:1;jenkins-hbase4:40297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40297,1675782195681' 2023-02-07 15:03:15,980 DEBUG [RS:0;jenkins-hbase4:40387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40387,1675782195645' 2023-02-07 15:03:15,980 DEBUG [RS:0;jenkins-hbase4:40387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:15,980 DEBUG [RS:1;jenkins-hbase4:40297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:15,981 DEBUG [RS:0;jenkins-hbase4:40387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:15,981 DEBUG [RS:1;jenkins-hbase4:40297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:15,981 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:15,981 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:15,981 DEBUG [RS:0;jenkins-hbase4:40387] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:15,981 DEBUG [RS:0;jenkins-hbase4:40387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40387,1675782195645' 2023-02-07 15:03:15,981 DEBUG [RS:0;jenkins-hbase4:40387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:15,981 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:15,981 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:15,981 DEBUG [RS:1;jenkins-hbase4:40297] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:15,981 DEBUG [RS:1;jenkins-hbase4:40297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40297,1675782195681' 2023-02-07 15:03:15,981 DEBUG [RS:1;jenkins-hbase4:40297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:15,981 DEBUG [RS:0;jenkins-hbase4:40387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:15,982 DEBUG [RS:1;jenkins-hbase4:40297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:15,982 DEBUG [RS:0;jenkins-hbase4:40387] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:15,982 INFO [RS:0;jenkins-hbase4:40387] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:15,982 INFO [RS:0;jenkins-hbase4:40387] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:15,982 DEBUG [RS:1;jenkins-hbase4:40297] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:15,982 INFO [RS:1;jenkins-hbase4:40297] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:15,982 INFO [RS:1;jenkins-hbase4:40297] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:16,033 DEBUG [jenkins-hbase4:35177] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 15:03:16,033 DEBUG [jenkins-hbase4:35177] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:16,035 DEBUG [jenkins-hbase4:35177] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:16,035 DEBUG [jenkins-hbase4:35177] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:16,035 DEBUG [jenkins-hbase4:35177] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:16,036 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40297,1675782195681, state=OPENING 2023-02-07 15:03:16,038 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 15:03:16,039 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:16,039 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:16,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40297,1675782195681}] 2023-02-07 15:03:16,194 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:16,194 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:16,196 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:16,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 15:03:16,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:16,202 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40297%2C1675782195681.meta, suffix=.meta, logDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40297,1675782195681, archiveDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/oldWALs, maxLogs=32 2023-02-07 15:03:16,217 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK] 2023-02-07 15:03:16,217 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK] 2023-02-07 15:03:16,218 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40297,1675782195681/jenkins-hbase4.apache.org%2C40297%2C1675782195681.meta.1675782196203.meta 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK], DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK]] 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 15:03:16,219 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 15:03:16,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 15:03:16,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:16,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/info 2023-02-07 15:03:16,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/info 2023-02-07 15:03:16,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:16,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:16,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:16,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:16,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:16,225 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:16,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:16,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:16,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/table 2023-02-07 15:03:16,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/table 2023-02-07 15:03:16,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:16,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:16,228 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740 2023-02-07 15:03:16,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740 2023-02-07 15:03:16,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:16,232 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:16,233 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65708136, jitterRate=-0.02087247371673584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:16,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675782196220Writing region info on filesystem at 1675782196220Initializing all the Stores at 1675782196220Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782196220Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782196222 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782196222Cleaning up temporary data from old regions at 1675782196230 (+8 ms)Cleaning up detritus from prior splits at 1675782196231 (+1 ms)Running coprocessor post-open hooks at 1675782196233 (+2 ms)Region opened successfully at 1675782196233 2023-02-07 15:03:16,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675782196194 2023-02-07 15:03:16,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 15:03:16,238 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 15:03:16,238 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40297,1675782195681, state=OPEN 2023-02-07 15:03:16,240 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 15:03:16,240 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:16,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 15:03:16,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40297,1675782195681 in 201 msec 2023-02-07 15:03:16,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 15:03:16,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-07 15:03:16,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 402 msec 2023-02-07 15:03:16,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675782195703, completionTime=-1 2023-02-07 15:03:16,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 15:03:16,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 15:03:16,251 DEBUG [hconnection-0x161c8748-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:16,253 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:16,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 15:03:16,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675782256254 2023-02-07 15:03:16,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675782316254 2023-02-07 15:03:16,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 9 msec 2023-02-07 15:03:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35177,1675782195595-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35177,1675782195595-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35177,1675782195595-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35177, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 15:03:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:16,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 15:03:16,264 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 15:03:16,264 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:16,265 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:16,266 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,267 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53 empty. 2023-02-07 15:03:16,267 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,267 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 15:03:16,279 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:16,280 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7e394cbee0c699873eeec74ddd468e53, NAME => 'hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp 2023-02-07 15:03:16,287 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:16,287 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7e394cbee0c699873eeec74ddd468e53, disabling compactions & flushes 2023-02-07 15:03:16,287 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:16,287 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:16,287 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. after waiting 0 ms 2023-02-07 15:03:16,287 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:16,287 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:16,287 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7e394cbee0c699873eeec74ddd468e53: Waiting for close lock at 1675782196287Disabling compacts and flushes for region at 1675782196287Disabling writes for close at 1675782196287Writing region close event to WAL at 1675782196287Closed at 1675782196287 2023-02-07 15:03:16,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:16,291 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782196290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782196290"}]},"ts":"1675782196290"} 2023-02-07 15:03:16,292 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:16,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:16,293 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782196293"}]},"ts":"1675782196293"} 2023-02-07 15:03:16,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 15:03:16,297 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:16,298 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:16,298 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:16,298 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:16,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7e394cbee0c699873eeec74ddd468e53, ASSIGN}] 2023-02-07 15:03:16,300 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7e394cbee0c699873eeec74ddd468e53, ASSIGN 2023-02-07 15:03:16,301 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7e394cbee0c699873eeec74ddd468e53, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40387,1675782195645; forceNewPlan=false, retain=false 2023-02-07 15:03:16,451 INFO [jenkins-hbase4:35177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:16,453 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7e394cbee0c699873eeec74ddd468e53, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:16,453 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782196453"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782196453"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782196453"}]},"ts":"1675782196453"} 2023-02-07 15:03:16,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7e394cbee0c699873eeec74ddd468e53, server=jenkins-hbase4.apache.org,40387,1675782195645}] 2023-02-07 15:03:16,607 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:16,608 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:16,609 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:16,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:16,615 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40387%2C1675782195645, suffix=, logDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40387,1675782195645, archiveDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/oldWALs, maxLogs=32 2023-02-07 15:03:16,630 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK] 2023-02-07 15:03:16,630 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK] 2023-02-07 15:03:16,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40387,1675782195645/jenkins-hbase4.apache.org%2C40387%2C1675782195645.1675782196615 2023-02-07 15:03:16,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK], DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK]] 2023-02-07 15:03:16,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e394cbee0c699873eeec74ddd468e53, NAME => 'hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:16,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:16,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,633 INFO [StoreOpener-7e394cbee0c699873eeec74ddd468e53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,635 DEBUG [StoreOpener-7e394cbee0c699873eeec74ddd468e53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/info 2023-02-07 15:03:16,635 DEBUG [StoreOpener-7e394cbee0c699873eeec74ddd468e53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/info 2023-02-07 15:03:16,635 INFO [StoreOpener-7e394cbee0c699873eeec74ddd468e53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e394cbee0c699873eeec74ddd468e53 columnFamilyName info 2023-02-07 15:03:16,635 INFO [StoreOpener-7e394cbee0c699873eeec74ddd468e53-1] regionserver.HStore(310): Store=7e394cbee0c699873eeec74ddd468e53/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:16,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,639 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:16,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:16,641 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7e394cbee0c699873eeec74ddd468e53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68680739, jitterRate=0.023422762751579285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:16,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7e394cbee0c699873eeec74ddd468e53: Running coprocessor pre-open hook at 1675782196632Writing region info on filesystem at 1675782196632Initializing all the Stores at 1675782196633 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782196633Cleaning up temporary data from old regions at 1675782196637 (+4 ms)Cleaning up detritus from prior splits at 1675782196637Running coprocessor post-open hooks at 1675782196641 (+4 ms)Region opened successfully at 1675782196641 2023-02-07 15:03:16,642 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53., pid=6, masterSystemTime=1675782196607 2023-02-07 15:03:16,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:16,646 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:16,647 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7e394cbee0c699873eeec74ddd468e53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:16,647 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782196647"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782196647"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782196647"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782196647"}]},"ts":"1675782196647"} 2023-02-07 15:03:16,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 15:03:16,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7e394cbee0c699873eeec74ddd468e53, server=jenkins-hbase4.apache.org,40387,1675782195645 in 194 msec 2023-02-07 15:03:16,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 15:03:16,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7e394cbee0c699873eeec74ddd468e53, ASSIGN in 353 msec 2023-02-07 15:03:16,653 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:16,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782196653"}]},"ts":"1675782196653"} 2023-02-07 15:03:16,655 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 15:03:16,657 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:16,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 396 msec 2023-02-07 15:03:16,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 15:03:16,665 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:16,665 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:16,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:16,669 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38168, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:16,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 15:03:16,678 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:16,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-07 15:03:16,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 15:03:16,703 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:16,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-07 15:03:16,716 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 15:03:16,719 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 15:03:16,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.011sec 2023-02-07 15:03:16,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 15:03:16,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 15:03:16,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 15:03:16,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35177,1675782195595-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 15:03:16,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35177,1675782195595-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 15:03:16,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 15:03:16,802 DEBUG [Listener at localhost/39115] zookeeper.ReadOnlyZKClient(139): Connect 0x507ebe79 to 127.0.0.1:58414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:16,807 DEBUG [Listener at localhost/39115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bc4205a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:16,809 DEBUG [hconnection-0x7d26fe9d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:16,810 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43066, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:16,812 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:16,812 DEBUG [Listener at localhost/39115] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 15:03:16,812 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:16,812 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:16,814 DEBUG [Listener at localhost/39115] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 15:03:16,815 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 15:03:16,816 INFO [Listener at localhost/39115] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:16,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:16,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 15:03:16,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:59702 deadline: 1675782256816, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:16,817 INFO [Listener at localhost/39115] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-07 15:03:16,817 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:16,817 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:16,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:16,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:16,822 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:16,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-07 15:03:16,822 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:16,822 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:16,822 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:16,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:16,824 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926 2023-02-07 15:03:16,824 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926 empty. 2023-02-07 15:03:16,825 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926 2023-02-07 15:03:16,825 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-07 15:03:16,834 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:16,835 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => f4988974eab0e941dac99316f60db926, NAME => 'testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp 2023-02-07 15:03:16,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:16,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing f4988974eab0e941dac99316f60db926, disabling compactions & flushes 2023-02-07 15:03:16,842 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:16,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:16,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. after waiting 0 ms 2023-02-07 15:03:16,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:16,842 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:16,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for f4988974eab0e941dac99316f60db926: Waiting for close lock at 1675782196842Disabling compacts and flushes for region at 1675782196842Disabling writes for close at 1675782196842Writing region close event to WAL at 1675782196842Closed at 1675782196842 2023-02-07 15:03:16,844 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:16,845 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675782196845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782196845"}]},"ts":"1675782196845"} 2023-02-07 15:03:16,847 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:16,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:16,848 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782196848"}]},"ts":"1675782196848"} 2023-02-07 15:03:16,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-07 15:03:16,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:16,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:16,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:16,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:16,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f4988974eab0e941dac99316f60db926, ASSIGN}] 2023-02-07 15:03:16,856 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f4988974eab0e941dac99316f60db926, ASSIGN 2023-02-07 15:03:16,857 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f4988974eab0e941dac99316f60db926, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40387,1675782195645; forceNewPlan=false, retain=false 2023-02-07 15:03:16,923 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:16,924 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:16,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:16,984 INFO [RS:1;jenkins-hbase4:40297] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40297%2C1675782195681, suffix=, logDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40297,1675782195681, archiveDir=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/oldWALs, maxLogs=32 2023-02-07 15:03:16,998 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK] 2023-02-07 15:03:16,999 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK] 2023-02-07 15:03:17,001 INFO [RS:1;jenkins-hbase4:40297] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/WALs/jenkins-hbase4.apache.org,40297,1675782195681/jenkins-hbase4.apache.org%2C40297%2C1675782195681.1675782196984 2023-02-07 15:03:17,001 DEBUG [RS:1;jenkins-hbase4:40297] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43387,DS-f18adbc2-1948-46a7-8503-c169c5ff58e9,DISK], DatanodeInfoWithStorage[127.0.0.1:45911,DS-8fc99fd8-ca3f-4390-8ab9-4d02beaeda1b,DISK]] 2023-02-07 15:03:17,007 INFO [jenkins-hbase4:35177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:17,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f4988974eab0e941dac99316f60db926, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675782197008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782197008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782197008"}]},"ts":"1675782197008"} 2023-02-07 15:03:17,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure f4988974eab0e941dac99316f60db926, server=jenkins-hbase4.apache.org,40387,1675782195645}] 2023-02-07 15:03:17,125 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:17,126 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:17,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:17,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:17,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f4988974eab0e941dac99316f60db926, NAME => 'testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:17,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:17,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,166 INFO [StoreOpener-f4988974eab0e941dac99316f60db926-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,168 DEBUG [StoreOpener-f4988974eab0e941dac99316f60db926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1 2023-02-07 15:03:17,168 DEBUG [StoreOpener-f4988974eab0e941dac99316f60db926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1 2023-02-07 15:03:17,168 INFO [StoreOpener-f4988974eab0e941dac99316f60db926-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4988974eab0e941dac99316f60db926 columnFamilyName f1 2023-02-07 15:03:17,169 INFO [StoreOpener-f4988974eab0e941dac99316f60db926-1] regionserver.HStore(310): Store=f4988974eab0e941dac99316f60db926/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:17,169 INFO [StoreOpener-f4988974eab0e941dac99316f60db926-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,170 DEBUG [StoreOpener-f4988974eab0e941dac99316f60db926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2 2023-02-07 15:03:17,170 DEBUG [StoreOpener-f4988974eab0e941dac99316f60db926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2 2023-02-07 15:03:17,170 INFO [StoreOpener-f4988974eab0e941dac99316f60db926-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4988974eab0e941dac99316f60db926 columnFamilyName f2 2023-02-07 15:03:17,170 INFO [StoreOpener-f4988974eab0e941dac99316f60db926-1] regionserver.HStore(310): Store=f4988974eab0e941dac99316f60db926/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:17,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:17,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f4988974eab0e941dac99316f60db926 2023-02-07 15:03:17,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:17,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f4988974eab0e941dac99316f60db926; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64294101, jitterRate=-0.04194323718547821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:17,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f4988974eab0e941dac99316f60db926: Running coprocessor pre-open hook at 1675782197165Writing region info on filesystem at 1675782197165Initializing all the Stores at 1675782197166 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782197166Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782197166Cleaning up temporary data from old regions at 1675782197172 (+6 ms)Cleaning up detritus from prior splits at 1675782197172Running coprocessor post-open hooks at 1675782197177 (+5 ms)Region opened successfully at 1675782197177 2023-02-07 15:03:17,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926., pid=12, masterSystemTime=1675782197161 2023-02-07 15:03:17,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:17,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:17,180 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f4988974eab0e941dac99316f60db926, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,180 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675782197180"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782197180"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782197180"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782197180"}]},"ts":"1675782197180"} 2023-02-07 15:03:17,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 15:03:17,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure f4988974eab0e941dac99316f60db926, server=jenkins-hbase4.apache.org,40387,1675782195645 in 172 msec 2023-02-07 15:03:17,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 15:03:17,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f4988974eab0e941dac99316f60db926, ASSIGN in 329 msec 2023-02-07 15:03:17,185 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:17,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782197185"}]},"ts":"1675782197185"} 2023-02-07 15:03:17,186 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-07 15:03:17,188 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:17,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 369 msec 2023-02-07 15:03:17,427 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:17,427 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:17,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:17,429 INFO [Listener at localhost/39115] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-07 15:03:17,429 DEBUG [Listener at localhost/39115] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-07 15:03:17,429 INFO [Listener at localhost/39115] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:17,431 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-07 15:03:17,431 INFO [Listener at localhost/39115] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:17,432 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-07 15:03:17,432 INFO [Listener at localhost/39115] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 15:03:17,453 DEBUG [hconnection-0x7d26fe9d-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:17,473 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38180, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:17,480 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40387] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:17,583 INFO [Listener at localhost/39115] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 15:03:17,583 INFO [Listener at localhost/39115] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 15:03:17,583 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:17,583 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:17,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 15:03:17,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675782197585 (current time:1675782197585). 2023-02-07 15:03:17,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 15:03:17,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] zookeeper.ReadOnlyZKClient(139): Connect 0x33b98bdb to 127.0.0.1:58414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:17,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68dcdafb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:17,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:17,593 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:17,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33b98bdb to 127.0.0.1:58414 2023-02-07 15:03:17,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 15:03:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 15:03:17,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 15:03:17,596 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 15:03:17,597 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675782797597 2023-02-07 15:03:17,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 15:03:17,598 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:17,598 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:17,599 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 15:03:17,599 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 15:03:17,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 15:03:17,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-07 15:03:17,601 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 15:03:17,601 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675782797601 2023-02-07 15:03:17,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-07 15:03:17,609 INFO [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-07 15:03:17,610 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:17,610 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-07 15:03:17,610 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-07 15:03:17,611 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,611 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:17,613 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:17,613 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:17,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:17,613 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:17,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:17,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:17,613 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,613 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:17,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 15:03:17,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-07 15:03:17,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 15:03:17,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 15:03:17,615 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 15:03:17,615 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:17,616 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 15:03:17,616 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 15:03:17,616 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:17,616 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 15:03:17,616 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40387,1675782195645' joining acquired barrier for procedure (foo) in zk 2023-02-07 15:03:17,616 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 15:03:17,617 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 15:03:17,617 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40297,1675782195681' joining acquired barrier for procedure (foo) in zk 2023-02-07 15:03:17,618 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,618 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:17,618 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:17,618 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,618 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:17,619 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:17,619 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:17,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:17,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:17,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40387,1675782195645' joining acquired barrier for procedure 'foo' on coordinator 2023-02-07 15:03:17,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1635536[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:17,623 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-07 15:03:17,623 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,624 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,624 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,625 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 15:03:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,625 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,625 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 15:03:17,628 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 15:03:17,628 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. started... 2023-02-07 15:03:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 15:03:17,629 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40297,1675782195681' in zk 2023-02-07 15:03:17,629 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f4988974eab0e941dac99316f60db926 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 15:03:17,631 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 15:03:17,631 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:17,631 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 15:03:17,652 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f1/e8d42f9c98f3416b854e211999e0b033 2023-02-07 15:03:17,677 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f2/442c25df07824c95a67214df5c384846 2023-02-07 15:03:17,682 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f1/e8d42f9c98f3416b854e211999e0b033 as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/e8d42f9c98f3416b854e211999e0b033 2023-02-07 15:03:17,686 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/e8d42f9c98f3416b854e211999e0b033, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:17,688 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f2/442c25df07824c95a67214df5c384846 as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/442c25df07824c95a67214df5c384846 2023-02-07 15:03:17,692 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/442c25df07824c95a67214df5c384846, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:17,693 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for f4988974eab0e941dac99316f60db926 in 64ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:17,693 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-07 15:03:17,694 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f4988974eab0e941dac99316f60db926: 2023-02-07 15:03:17,694 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.' region-info for snapshot=foo 2023-02-07 15:03:17,694 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:17,694 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/e8d42f9c98f3416b854e211999e0b033] hfiles 2023-02-07 15:03:17,694 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/e8d42f9c98f3416b854e211999e0b033 for snapshot=foo 2023-02-07 15:03:17,694 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/442c25df07824c95a67214df5c384846] hfiles 2023-02-07 15:03:17,694 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/442c25df07824c95a67214df5c384846 for snapshot=foo 2023-02-07 15:03:17,699 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:17,700 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:17,700 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:17,701 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. completed. 2023-02-07 15:03:17,701 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:17,701 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 15:03:17,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-07 15:03:17,701 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 15:03:17,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:17,701 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,701 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 15:03:17,701 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40387,1675782195645' in zk 2023-02-07 15:03:17,701 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 15:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 15:03:17,704 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 15:03:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,40387,1675782195645': 2023-02-07 15:03:17,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40387,1675782195645' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-07 15:03:17,708 INFO [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-07 15:03:17,708 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:17,708 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:17,708 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-07 15:03:17,708 INFO [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 15:03:17,709 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,709 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,710 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:17,709 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:17,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:17,710 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,710 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:17,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:17,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:17,711 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,712 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:17,712 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:17,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:17,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-07 15:03:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:17,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:17,717 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:17,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:17,717 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:17,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:17,718 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:17,719 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:17,719 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:17,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.hbase-snapshot/.tmp/foo 2023-02-07 15:03:17,719 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:17,719 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:17,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:17,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.hbase-snapshot/.tmp/foo to hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.hbase-snapshot/foo 2023-02-07 15:03:17,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-07 15:03:17,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.hbase-snapshot/.tmp/foo 2023-02-07 15:03:17,750 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.hbase-snapshot/.tmp/foo 2023-02-07 15:03:17,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675782197598Consolidate snapshot: foo at 1675782197717 (+119 ms)Loading Region manifests for foo at 1675782197717Writing data manifest for foo at 1675782197721 (+4 ms)Verifying snapshot: foo at 1675782197728 (+7 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675782197749 (+21 ms) 2023-02-07 15:03:17,751 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 15:03:17,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 153 msec 2023-02-07 15:03:17,901 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:17,901 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:17,902 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:17,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-07 15:03:17,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 15:03:17,903 INFO [Listener at localhost/39115] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 15:03:17,903 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:17,903 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:17,907 INFO [Listener at localhost/39115] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 15:03:17,913 INFO [Listener at localhost/39115] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 15:03:17,943 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40387] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,029 INFO [Listener at localhost/39115] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 15:03:18,033 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,033 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 15:03:18,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,037 INFO [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-07 15:03:18,037 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:18,038 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-07 15:03:18,038 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-07 15:03:18,038 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,038 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,041 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:18,041 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:18,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:18,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:18,041 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,042 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,042 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,042 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,049 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-07 15:03:18,049 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:18,049 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-07 15:03:18,050 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:18,050 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-07 15:03:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-07 15:03:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-07 15:03:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40297,1675782195681' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-07 15:03:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 15:03:18,051 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:18,051 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. started... 2023-02-07 15:03:18,051 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f4988974eab0e941dac99316f60db926 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 15:03:18,053 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,054 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,054 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:18,073 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f1/1ba1e47a9bef4db686c642119bfae99e 2023-02-07 15:03:18,099 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f2/fd97fdcf83a14c049e6378e8ac527a03 2023-02-07 15:03:18,104 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f1/1ba1e47a9bef4db686c642119bfae99e as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/1ba1e47a9bef4db686c642119bfae99e 2023-02-07 15:03:18,109 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/1ba1e47a9bef4db686c642119bfae99e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:18,110 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/.tmp/f2/fd97fdcf83a14c049e6378e8ac527a03 as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/fd97fdcf83a14c049e6378e8ac527a03 2023-02-07 15:03:18,114 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/fd97fdcf83a14c049e6378e8ac527a03, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:18,115 INFO [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for f4988974eab0e941dac99316f60db926 in 64ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:18,116 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f4988974eab0e941dac99316f60db926: 2023-02-07 15:03:18,116 DEBUG [rs(jenkins-hbase4.apache.org,40387,1675782195645)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 15:03:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 15:03:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-07 15:03:18,117 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40387,1675782195645' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-07 15:03:18,118 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,118 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:18,119 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,119 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:18,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40387,1675782195645' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-07 15:03:18,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55cd1c2[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:18,121 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-07 15:03:18,121 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,122 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,122 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,122 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-07 15:03:18,122 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-07 15:03:18,122 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-07 15:03:18,122 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,122 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:18,122 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-07 15:03:18,122 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,40387,1675782195645' in zk 2023-02-07 15:03:18,122 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,40297,1675782195681' in zk 2023-02-07 15:03:18,125 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-07 15:03:18,125 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-07 15:03:18,125 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:18,125 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,125 DEBUG [member: 'jenkins-hbase4.apache.org,40387,1675782195645' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-07 15:03:18,125 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:18,126 DEBUG [member: 'jenkins-hbase4.apache.org,40297,1675782195681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-07 15:03:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,40387,1675782195645': 2023-02-07 15:03:18,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40387,1675782195645' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-07 15:03:18,130 INFO [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-07 15:03:18,130 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:18,130 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:18,130 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,130 INFO [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 15:03:18,132 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:18,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:18,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:18,132 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:18,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,132 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:18,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:18,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:18,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:18,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:18,133 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:18,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,135 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,135 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:18,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:18,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:18,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-07 15:03:18,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:18,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:18,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:18,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:18,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,138 DEBUG [(jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,138 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:18,139 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 15:03:18,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:18,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:18,139 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,140 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,140 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,239 DEBUG [Listener at localhost/39115] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 15:03:18,240 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,240 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 15:03:18,246 INFO [Listener at localhost/39115] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675782197585 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:18,246 DEBUG [Listener at localhost/39115] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33975/user/jenkins/test-data/bdd431af-e12a-95ed-d474-7d08bc49d667/foo/cc0946e6-f144-4e58-8e5f-2592cf9417d8/data/default/testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,246 INFO [Listener at localhost/39115] snapshot.RestoreSnapshotHelper(239): region to add: f4988974eab0e941dac99316f60db926 2023-02-07 15:03:18,246 INFO [Listener at localhost/39115] snapshot.RestoreSnapshotHelper(585): clone region=f4988974eab0e941dac99316f60db926 as f4988974eab0e941dac99316f60db926 in snapshot foo 2023-02-07 15:03:18,247 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f4988974eab0e941dac99316f60db926, NAME => 'testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33975/user/jenkins/test-data/bdd431af-e12a-95ed-d474-7d08bc49d667/foo/cc0946e6-f144-4e58-8e5f-2592cf9417d8 2023-02-07 15:03:18,260 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:18,261 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e8d42f9c98f3416b854e211999e0b033 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,263 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 442c25df07824c95a67214df5c384846 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f4988974eab0e941dac99316f60db926, disabling compactions & flushes 2023-02-07 15:03:18,265 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. after waiting 0 ms 2023-02-07 15:03:18,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,265 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f4988974eab0e941dac99316f60db926: Waiting for close lock at 1675782198265Disabling compacts and flushes for region at 1675782198265Disabling writes for close at 1675782198265Writing region close event to WAL at 1675782198265Closed at 1675782198265 2023-02-07 15:03:18,266 INFO [Listener at localhost/39115] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675782197585 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:18,266 DEBUG [Listener at localhost/39115] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33975/user/jenkins/test-data/bdd431af-e12a-95ed-d474-7d08bc49d667/foo/cc0946e6-f144-4e58-8e5f-2592cf9417d8 2023-02-07 15:03:18,266 DEBUG [Listener at localhost/39115] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33975/user/jenkins/test-data/bdd431af-e12a-95ed-d474-7d08bc49d667/foo/cc0946e6-f144-4e58-8e5f-2592cf9417d8 2023-02-07 15:03:18,267 DEBUG [Listener at localhost/39115] util.CommonFSUtils(699): |-data/ 2023-02-07 15:03:18,267 DEBUG [Listener at localhost/39115] util.CommonFSUtils(699): |----default/ 2023-02-07 15:03:18,267 DEBUG [Listener at localhost/39115] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-07 15:03:18,268 DEBUG [Listener at localhost/39115] util.CommonFSUtils(699): |----------f4988974eab0e941dac99316f60db926/ 2023-02-07 15:03:18,268 DEBUG [Listener at localhost/39115] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:18,269 DEBUG [Listener at localhost/39115] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:18,269 DEBUG [Listener at localhost/39115] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=f4988974eab0e941dac99316f60db926-e8d42f9c98f3416b854e211999e0b033 2023-02-07 15:03:18,269 DEBUG [Listener at localhost/39115] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:18,269 DEBUG [Listener at localhost/39115] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=f4988974eab0e941dac99316f60db926-442c25df07824c95a67214df5c384846 2023-02-07 15:03:18,270 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,270 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-07 15:03:18,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-07 15:03:18,274 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,274 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,274 INFO [Listener at localhost/39115] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,277 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,277 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782198278"}]},"ts":"1675782198278"} 2023-02-07 15:03:18,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:18,279 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-07 15:03:18,281 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-07 15:03:18,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f4988974eab0e941dac99316f60db926, UNASSIGN}] 2023-02-07 15:03:18,283 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f4988974eab0e941dac99316f60db926, UNASSIGN 2023-02-07 15:03:18,283 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f4988974eab0e941dac99316f60db926, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675782198283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782198283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782198283"}]},"ts":"1675782198283"} 2023-02-07 15:03:18,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure f4988974eab0e941dac99316f60db926, server=jenkins-hbase4.apache.org,40387,1675782195645}] 2023-02-07 15:03:18,379 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,379 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:18,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f4988974eab0e941dac99316f60db926 2023-02-07 15:03:18,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f4988974eab0e941dac99316f60db926, disabling compactions & flushes 2023-02-07 15:03:18,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. after waiting 0 ms 2023-02-07 15:03:18,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:18,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926. 2023-02-07 15:03:18,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f4988974eab0e941dac99316f60db926: Waiting for close lock at 1675782198437Running coprocessor pre-close hooks at 1675782198437Disabling compacts and flushes for region at 1675782198437Disabling writes for close at 1675782198437Writing region close event to WAL at 1675782198438 (+1 ms)Running coprocessor post-close hooks at 1675782198442 (+4 ms)Closed at 1675782198442 2023-02-07 15:03:18,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f4988974eab0e941dac99316f60db926 2023-02-07 15:03:18,444 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f4988974eab0e941dac99316f60db926, regionState=CLOSED 2023-02-07 15:03:18,444 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675782198444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782198444"}]},"ts":"1675782198444"} 2023-02-07 15:03:18,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 15:03:18,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure f4988974eab0e941dac99316f60db926, server=jenkins-hbase4.apache.org,40387,1675782195645 in 160 msec 2023-02-07 15:03:18,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 15:03:18,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f4988974eab0e941dac99316f60db926, UNASSIGN in 166 msec 2023-02-07 15:03:18,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782198449"}]},"ts":"1675782198449"} 2023-02-07 15:03:18,451 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-07 15:03:18,453 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-07 15:03:18,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 178 msec 2023-02-07 15:03:18,580 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,581 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:18,582 INFO [Listener at localhost/39115] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-07 15:03:18,582 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,582 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,585 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,585 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,586 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,586 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:18,589 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926 2023-02-07 15:03:18,591 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1, FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2, FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/recovered.edits] 2023-02-07 15:03:18,594 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/1ba1e47a9bef4db686c642119bfae99e to hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/archive/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/1ba1e47a9bef4db686c642119bfae99e 2023-02-07 15:03:18,596 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/e8d42f9c98f3416b854e211999e0b033 to hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/archive/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f1/e8d42f9c98f3416b854e211999e0b033 2023-02-07 15:03:18,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/442c25df07824c95a67214df5c384846 to hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/archive/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/442c25df07824c95a67214df5c384846 2023-02-07 15:03:18,600 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/fd97fdcf83a14c049e6378e8ac527a03 to hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/archive/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/f2/fd97fdcf83a14c049e6378e8ac527a03 2023-02-07 15:03:18,602 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/recovered.edits/12.seqid to hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/archive/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926/recovered.edits/12.seqid 2023-02-07 15:03:18,603 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f4988974eab0e941dac99316f60db926 2023-02-07 15:03:18,603 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-07 15:03:18,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,606 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-07 15:03:18,608 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-07 15:03:18,609 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,609 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-07 15:03:18,609 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782198609"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:18,611 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 15:03:18,611 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f4988974eab0e941dac99316f60db926, NAME => 'testInitTableSnapshotMapperJobConfig,,1675782196819.f4988974eab0e941dac99316f60db926.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 15:03:18,611 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-07 15:03:18,611 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675782198611"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:18,615 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-07 15:03:18,617 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 15:03:18,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-07 15:03:18,687 INFO [Listener at localhost/39115] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:18,687 INFO [Listener at localhost/39115] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:18,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:18,688 INFO [Listener at localhost/39115] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-07 15:03:18,688 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 15:03:18,688 INFO [Listener at localhost/39115] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 15:03:18,689 DEBUG [Listener at localhost/39115] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x507ebe79 to 127.0.0.1:58414 2023-02-07 15:03:18,689 DEBUG [Listener at localhost/39115] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:18,689 DEBUG [Listener at localhost/39115] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 15:03:18,689 DEBUG [Listener at localhost/39115] util.JVMClusterUtil(257): Found active master hash=757659792, stopped=false 2023-02-07 15:03:18,689 INFO [Listener at localhost/39115] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:18,691 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:18,691 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:18,691 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:18,691 INFO [Listener at localhost/39115] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 15:03:18,691 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:18,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:18,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:18,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:18,693 DEBUG [Listener at localhost/39115] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68edc2c1 to 127.0.0.1:58414 2023-02-07 15:03:18,693 DEBUG [Listener at localhost/39115] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:18,693 INFO [Listener at localhost/39115] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40387,1675782195645' ***** 2023-02-07 15:03:18,693 INFO [Listener at localhost/39115] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:18,693 INFO [Listener at localhost/39115] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40297,1675782195681' ***** 2023-02-07 15:03:18,693 INFO [Listener at localhost/39115] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:18,693 INFO [RS:0;jenkins-hbase4:40387] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:18,693 INFO [RS:1;jenkins-hbase4:40297] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:18,693 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:18,693 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:18,693 INFO [RS:0;jenkins-hbase4:40387] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:18,695 INFO [RS:0;jenkins-hbase4:40387] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:18,695 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(3304): Received CLOSE for 7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:18,695 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,695 DEBUG [RS:0;jenkins-hbase4:40387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38b40dd5 to 127.0.0.1:58414 2023-02-07 15:03:18,694 INFO [RS:1;jenkins-hbase4:40297] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:18,696 DEBUG [RS:0;jenkins-hbase4:40387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:18,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7e394cbee0c699873eeec74ddd468e53, disabling compactions & flushes 2023-02-07 15:03:18,696 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:18,696 INFO [RS:1;jenkins-hbase4:40297] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:18,696 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1479): Online Regions={7e394cbee0c699873eeec74ddd468e53=hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53.} 2023-02-07 15:03:18,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:18,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:18,696 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. after waiting 0 ms 2023-02-07 15:03:18,696 DEBUG [RS:1;jenkins-hbase4:40297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63edc502 to 127.0.0.1:58414 2023-02-07 15:03:18,696 DEBUG [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1505): Waiting on 7e394cbee0c699873eeec74ddd468e53 2023-02-07 15:03:18,696 DEBUG [RS:1;jenkins-hbase4:40297] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:18,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:18,697 INFO [RS:1;jenkins-hbase4:40297] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:18,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 7e394cbee0c699873eeec74ddd468e53 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 15:03:18,697 INFO [RS:1;jenkins-hbase4:40297] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:18,697 INFO [RS:1;jenkins-hbase4:40297] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:18,697 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 15:03:18,698 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:18,698 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 15:03:18,698 DEBUG [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:18,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:18,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:18,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:18,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:18,699 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:18,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-07 15:03:18,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/.tmp/info/f1f8acdc3d4e4f3cb30d0d4134fbbfdb 2023-02-07 15:03:18,723 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/.tmp/info/1f2b2dc6db4442eb966f7ba098bcadf0 2023-02-07 15:03:18,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/.tmp/info/f1f8acdc3d4e4f3cb30d0d4134fbbfdb as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/info/f1f8acdc3d4e4f3cb30d0d4134fbbfdb 2023-02-07 15:03:18,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f2b2dc6db4442eb966f7ba098bcadf0 2023-02-07 15:03:18,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/info/f1f8acdc3d4e4f3cb30d0d4134fbbfdb, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 15:03:18,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7e394cbee0c699873eeec74ddd468e53 in 35ms, sequenceid=6, compaction requested=false 2023-02-07 15:03:18,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/namespace/7e394cbee0c699873eeec74ddd468e53/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 15:03:18,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:18,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7e394cbee0c699873eeec74ddd468e53: Waiting for close lock at 1675782198695Running coprocessor pre-close hooks at 1675782198695Disabling compacts and flushes for region at 1675782198695Disabling writes for close at 1675782198696 (+1 ms)Obtaining lock to block concurrent updates at 1675782198697 (+1 ms)Preparing flush snapshotting stores in 7e394cbee0c699873eeec74ddd468e53 at 1675782198697Finished memstore snapshotting hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675782198698 (+1 ms)Flushing stores of hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. at 1675782198699 (+1 ms)Flushing 7e394cbee0c699873eeec74ddd468e53/info: creating writer at 1675782198699Flushing 7e394cbee0c699873eeec74ddd468e53/info: appending metadata at 1675782198703 (+4 ms)Flushing 7e394cbee0c699873eeec74ddd468e53/info: closing flushed file at 1675782198703Flushing 7e394cbee0c699873eeec74ddd468e53/info: reopening flushed file at 1675782198727 (+24 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7e394cbee0c699873eeec74ddd468e53 in 35ms, sequenceid=6, compaction requested=false at 1675782198732 (+5 ms)Writing region close event to WAL at 1675782198732Running coprocessor post-close hooks at 1675782198736 (+4 ms)Closed at 1675782198736 2023-02-07 15:03:18,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675782196262.7e394cbee0c699873eeec74ddd468e53. 2023-02-07 15:03:18,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/.tmp/rep_barrier/e038362e00474ae4af176da0dee89b4c 2023-02-07 15:03:18,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e038362e00474ae4af176da0dee89b4c 2023-02-07 15:03:18,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/.tmp/table/43ce97d41e954fa080eb861a22d6de03 2023-02-07 15:03:18,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43ce97d41e954fa080eb861a22d6de03 2023-02-07 15:03:18,754 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/.tmp/info/1f2b2dc6db4442eb966f7ba098bcadf0 as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/info/1f2b2dc6db4442eb966f7ba098bcadf0 2023-02-07 15:03:18,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f2b2dc6db4442eb966f7ba098bcadf0 2023-02-07 15:03:18,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/info/1f2b2dc6db4442eb966f7ba098bcadf0, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 15:03:18,759 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:18,759 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:18,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/.tmp/rep_barrier/e038362e00474ae4af176da0dee89b4c as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/rep_barrier/e038362e00474ae4af176da0dee89b4c 2023-02-07 15:03:18,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e038362e00474ae4af176da0dee89b4c 2023-02-07 15:03:18,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/rep_barrier/e038362e00474ae4af176da0dee89b4c, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 15:03:18,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/.tmp/table/43ce97d41e954fa080eb861a22d6de03 as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/table/43ce97d41e954fa080eb861a22d6de03 2023-02-07 15:03:18,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43ce97d41e954fa080eb861a22d6de03 2023-02-07 15:03:18,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/table/43ce97d41e954fa080eb861a22d6de03, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 15:03:18,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=21, compaction requested=false 2023-02-07 15:03:18,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 15:03:18,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:18,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:18,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782198698Running coprocessor pre-close hooks at 1675782198698Disabling compacts and flushes for region at 1675782198698Disabling writes for close at 1675782198699 (+1 ms)Obtaining lock to block concurrent updates at 1675782198699Preparing flush snapshotting stores in 1588230740 at 1675782198699Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675782198699Flushing stores of hbase:meta,,1.1588230740 at 1675782198701 (+2 ms)Flushing 1588230740/info: creating writer at 1675782198701Flushing 1588230740/info: appending metadata at 1675782198704 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675782198704Flushing 1588230740/rep_barrier: creating writer at 1675782198728 (+24 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675782198729 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675782198729Flushing 1588230740/table: creating writer at 1675782198742 (+13 ms)Flushing 1588230740/table: appending metadata at 1675782198744 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675782198744Flushing 1588230740/info: reopening flushed file at 1675782198755 (+11 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675782198762 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1675782198767 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=21, compaction requested=false at 1675782198771 (+4 ms)Writing region close event to WAL at 1675782198772 (+1 ms)Running coprocessor post-close hooks at 1675782198776 (+4 ms)Closed at 1675782198776 2023-02-07 15:03:18,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:18,896 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40387,1675782195645; all regions closed. 2023-02-07 15:03:18,898 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40297,1675782195681; all regions closed. 2023-02-07 15:03:18,903 DEBUG [RS:0;jenkins-hbase4:40387] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/oldWALs 2023-02-07 15:03:18,903 INFO [RS:0;jenkins-hbase4:40387] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40387%2C1675782195645:(num 1675782196615) 2023-02-07 15:03:18,903 DEBUG [RS:0;jenkins-hbase4:40387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:18,904 INFO [RS:0;jenkins-hbase4:40387] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:18,904 INFO [RS:0;jenkins-hbase4:40387] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:18,904 INFO [RS:0;jenkins-hbase4:40387] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:18,904 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:18,904 INFO [RS:0;jenkins-hbase4:40387] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:18,904 INFO [RS:0;jenkins-hbase4:40387] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:18,905 INFO [RS:0;jenkins-hbase4:40387] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40387 2023-02-07 15:03:18,905 DEBUG [RS:1;jenkins-hbase4:40297] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/oldWALs 2023-02-07 15:03:18,905 INFO [RS:1;jenkins-hbase4:40297] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40297%2C1675782195681.meta:.meta(num 1675782196203) 2023-02-07 15:03:18,907 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,908 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40387,1675782195645 2023-02-07 15:03:18,908 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:18,908 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:18,908 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@625239c8 rejected from java.util.concurrent.ThreadPoolExecutor@666db15a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:18,908 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:18,909 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40387,1675782195645] 2023-02-07 15:03:18,909 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40387,1675782195645; numProcessing=1 2023-02-07 15:03:18,910 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40387,1675782195645 already deleted, retry=false 2023-02-07 15:03:18,910 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40387,1675782195645 expired; onlineServers=1 2023-02-07 15:03:18,910 DEBUG [RS:1;jenkins-hbase4:40297] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/oldWALs 2023-02-07 15:03:18,911 INFO [RS:1;jenkins-hbase4:40297] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40297%2C1675782195681:(num 1675782196984) 2023-02-07 15:03:18,911 DEBUG [RS:1;jenkins-hbase4:40297] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:18,911 INFO [RS:1;jenkins-hbase4:40297] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:18,911 INFO [RS:1;jenkins-hbase4:40297] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:18,911 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:18,911 INFO [RS:1;jenkins-hbase4:40297] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40297 2023-02-07 15:03:18,914 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40297,1675782195681 2023-02-07 15:03:18,914 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:18,914 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ff056fe rejected from java.util.concurrent.ThreadPoolExecutor@6bcfdfd8[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:18,915 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40297,1675782195681] 2023-02-07 15:03:18,915 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40297,1675782195681; numProcessing=2 2023-02-07 15:03:18,916 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40297,1675782195681 already deleted, retry=false 2023-02-07 15:03:18,917 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40297,1675782195681 expired; onlineServers=0 2023-02-07 15:03:18,917 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35177,1675782195595' ***** 2023-02-07 15:03:18,917 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 15:03:18,917 DEBUG [M:0;jenkins-hbase4:35177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@291769ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:18,917 INFO [M:0;jenkins-hbase4:35177] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35177,1675782195595 2023-02-07 15:03:18,917 INFO [M:0;jenkins-hbase4:35177] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35177,1675782195595; all regions closed. 2023-02-07 15:03:18,917 DEBUG [M:0;jenkins-hbase4:35177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:18,918 DEBUG [M:0;jenkins-hbase4:35177] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 15:03:18,918 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 15:03:18,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782195847] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782195847,5,FailOnTimeoutGroup] 2023-02-07 15:03:18,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782195848] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782195848,5,FailOnTimeoutGroup] 2023-02-07 15:03:18,918 DEBUG [M:0;jenkins-hbase4:35177] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 15:03:18,921 INFO [M:0;jenkins-hbase4:35177] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 15:03:18,921 INFO [M:0;jenkins-hbase4:35177] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 15:03:18,921 INFO [M:0;jenkins-hbase4:35177] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 15:03:18,921 DEBUG [M:0;jenkins-hbase4:35177] master.HMaster(1502): Stopping service threads 2023-02-07 15:03:18,921 INFO [M:0;jenkins-hbase4:35177] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 15:03:18,922 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:18,922 ERROR [M:0;jenkins-hbase4:35177] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 15:03:18,922 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:18,922 INFO [M:0;jenkins-hbase4:35177] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 15:03:18,922 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 15:03:18,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:18,922 DEBUG [M:0;jenkins-hbase4:35177] zookeeper.ZKUtil(398): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 15:03:18,922 WARN [M:0;jenkins-hbase4:35177] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 15:03:18,922 INFO [M:0;jenkins-hbase4:35177] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 15:03:18,923 INFO [M:0;jenkins-hbase4:35177] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 15:03:18,923 DEBUG [M:0;jenkins-hbase4:35177] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:18,923 INFO [M:0;jenkins-hbase4:35177] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:18,923 DEBUG [M:0;jenkins-hbase4:35177] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:18,924 DEBUG [M:0;jenkins-hbase4:35177] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:18,924 DEBUG [M:0;jenkins-hbase4:35177] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:18,924 INFO [M:0;jenkins-hbase4:35177] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-07 15:03:18,932 INFO [M:0;jenkins-hbase4:35177] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/632e6f686de1455baf38e05d2316a44e 2023-02-07 15:03:18,936 DEBUG [M:0;jenkins-hbase4:35177] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/632e6f686de1455baf38e05d2316a44e as hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/632e6f686de1455baf38e05d2316a44e 2023-02-07 15:03:18,940 INFO [M:0;jenkins-hbase4:35177] regionserver.HStore(1080): Added hdfs://localhost:33975/user/jenkins/test-data/23e3141a-5664-d66a-01f2-dde7d7c6745d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/632e6f686de1455baf38e05d2316a44e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 15:03:18,940 INFO [M:0;jenkins-hbase4:35177] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-07 15:03:18,941 INFO [M:0;jenkins-hbase4:35177] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:18,941 DEBUG [M:0;jenkins-hbase4:35177] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782198923Disabling compacts and flushes for region at 1675782198923Disabling writes for close at 1675782198924 (+1 ms)Obtaining lock to block concurrent updates at 1675782198924Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675782198924Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57248, getHeapSize=68440, getOffHeapSize=0, getCellsCount=145 at 1675782198924Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675782198925 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675782198925Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675782198927 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675782198927Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675782198937 (+10 ms)Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675782198941 (+4 ms)Writing region close event to WAL at 1675782198941Closed at 1675782198941 2023-02-07 15:03:18,944 INFO [M:0;jenkins-hbase4:35177] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 15:03:18,944 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:18,945 INFO [M:0;jenkins-hbase4:35177] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35177 2023-02-07 15:03:18,947 DEBUG [M:0;jenkins-hbase4:35177] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35177,1675782195595 already deleted, retry=false 2023-02-07 15:03:19,191 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:19,191 INFO [M:0;jenkins-hbase4:35177] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35177,1675782195595; zookeeper connection closed. 2023-02-07 15:03:19,192 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c9d2943 rejected from java.util.concurrent.ThreadPoolExecutor@78a2a208[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:19,193 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): master:35177-0x1002f4ef33e0000, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:19,193 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19953cbd rejected from java.util.concurrent.ThreadPoolExecutor@78a2a208[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:19,292 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:19,292 INFO [RS:1;jenkins-hbase4:40297] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40297,1675782195681; zookeeper connection closed. 2023-02-07 15:03:19,292 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72033f40 rejected from java.util.concurrent.ThreadPoolExecutor@6bcfdfd8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:19,292 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40297-0x1002f4ef33e0002, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:19,292 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f94c37f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f94c37f 2023-02-07 15:03:19,292 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a8ded6a rejected from java.util.concurrent.ThreadPoolExecutor@6bcfdfd8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:19,392 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:19,392 INFO [RS:0;jenkins-hbase4:40387] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40387,1675782195645; zookeeper connection closed. 2023-02-07 15:03:19,392 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6169f93e rejected from java.util.concurrent.ThreadPoolExecutor@666db15a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:19,392 DEBUG [Listener at localhost/39115-EventThread] zookeeper.ZKWatcher(600): regionserver:40387-0x1002f4ef33e0001, quorum=127.0.0.1:58414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:19,392 ERROR [Listener at localhost/39115-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19ea84d9 rejected from java.util.concurrent.ThreadPoolExecutor@666db15a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:19,392 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@443de41e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@443de41e 2023-02-07 15:03:19,392 INFO [Listener at localhost/39115] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 15:03:19,393 WARN [Listener at localhost/39115] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:19,397 INFO [Listener at localhost/39115] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:19,502 WARN [BP-267309951-172.31.14.131-1675782195024 heartbeating to localhost/127.0.0.1:33975] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:19,502 WARN [BP-267309951-172.31.14.131-1675782195024 heartbeating to localhost/127.0.0.1:33975] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-267309951-172.31.14.131-1675782195024 (Datanode Uuid 9fdb9afa-3b01-4901-a195-df0c1290769d) service to localhost/127.0.0.1:33975 2023-02-07 15:03:19,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85/dfs/data/data3/current/BP-267309951-172.31.14.131-1675782195024] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:19,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85/dfs/data/data4/current/BP-267309951-172.31.14.131-1675782195024] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:19,505 WARN [Listener at localhost/39115] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:19,510 INFO [Listener at localhost/39115] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:19,614 WARN [BP-267309951-172.31.14.131-1675782195024 heartbeating to localhost/127.0.0.1:33975] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:19,614 WARN [BP-267309951-172.31.14.131-1675782195024 heartbeating to localhost/127.0.0.1:33975] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-267309951-172.31.14.131-1675782195024 (Datanode Uuid e80a3450-2806-461f-9b9f-0390f4537072) service to localhost/127.0.0.1:33975 2023-02-07 15:03:19,615 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85/dfs/data/data1/current/BP-267309951-172.31.14.131-1675782195024] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:19,615 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/cluster_2c69a5fb-7e30-37cb-a482-54b1a41fce85/dfs/data/data2/current/BP-267309951-172.31.14.131-1675782195024] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:19,626 INFO [Listener at localhost/39115] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:19,740 INFO [Listener at localhost/39115] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 15:03:19,755 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 15:03:19,767 INFO [Listener at localhost/39115] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 155) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35177,1675782195595)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39115 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:33975 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:33975 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:33975 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:33975 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:33975 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:33975 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33975 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=567 (was 535) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 317), ProcessCount=166 (was 166), AvailableMemoryMB=5650 (was 5675) 2023-02-07 15:03:19,776 INFO [Listener at localhost/39115] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=166, AvailableMemoryMB=5650 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/hadoop.log.dir so I do NOT create it in target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5 2023-02-07 15:03:19,787 WARN [Listener at localhost/39115] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/hadoop.tmp.dir so I do NOT create it in target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5 2023-02-07 15:03:19,787 WARN [Listener at localhost/39115] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/85fdd263-64b1-69a2-5392-034a8fe8513f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 15:03:19,787 DEBUG [Listener at localhost/39115] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e, deleteOnExit=true 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/test.cache.data in system properties and HBase conf 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 15:03:19,787 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/hadoop.log.dir in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 15:03:19,788 DEBUG [Listener at localhost/39115] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 15:03:19,788 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/nfs.dump.dir in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/java.io.tmpdir in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 15:03:19,789 INFO [Listener at localhost/39115] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 15:03:19,793 WARN [Listener at localhost/39115] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:19,793 WARN [Listener at localhost/39115] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:19,838 WARN [Listener at localhost/39115] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:19,840 INFO [Listener at localhost/39115] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:19,844 INFO [Listener at localhost/39115] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/java.io.tmpdir/Jetty_localhost_34691_hdfs____xl4vav/webapp 2023-02-07 15:03:19,936 INFO [Listener at localhost/39115] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34691 2023-02-07 15:03:19,940 WARN [Listener at localhost/39115] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:19,940 WARN [Listener at localhost/39115] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:20,076 WARN [Listener at localhost/35559] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:20,115 WARN [Listener at localhost/35559] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:20,118 WARN [Listener at localhost/35559] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:20,119 INFO [Listener at localhost/35559] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:20,127 INFO [Listener at localhost/35559] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/java.io.tmpdir/Jetty_localhost_35597_datanode____z0n8bc/webapp 2023-02-07 15:03:20,218 INFO [Listener at localhost/35559] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35597 2023-02-07 15:03:20,228 WARN [Listener at localhost/36443] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:20,248 WARN [Listener at localhost/36443] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:20,250 WARN [Listener at localhost/36443] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:20,252 INFO [Listener at localhost/36443] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:20,256 INFO [Listener at localhost/36443] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/java.io.tmpdir/Jetty_localhost_40639_datanode____my3vgn/webapp 2023-02-07 15:03:20,334 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa2fbfebe6b931a8d: Processing first storage report for DS-a69a5b81-cca6-415e-b46e-eb6caccc2535 from datanode e0722cb5-6283-4581-aa16-6c2a6db13a51 2023-02-07 15:03:20,334 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa2fbfebe6b931a8d: from storage DS-a69a5b81-cca6-415e-b46e-eb6caccc2535 node DatanodeRegistration(127.0.0.1:43277, datanodeUuid=e0722cb5-6283-4581-aa16-6c2a6db13a51, infoPort=40631, infoSecurePort=0, ipcPort=36443, storageInfo=lv=-57;cid=testClusterID;nsid=963834926;c=1675782199796), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:20,334 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa2fbfebe6b931a8d: Processing first storage report for DS-b98da0d7-c147-46f5-91fb-55dcc6226a92 from datanode e0722cb5-6283-4581-aa16-6c2a6db13a51 2023-02-07 15:03:20,334 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa2fbfebe6b931a8d: from storage DS-b98da0d7-c147-46f5-91fb-55dcc6226a92 node DatanodeRegistration(127.0.0.1:43277, datanodeUuid=e0722cb5-6283-4581-aa16-6c2a6db13a51, infoPort=40631, infoSecurePort=0, ipcPort=36443, storageInfo=lv=-57;cid=testClusterID;nsid=963834926;c=1675782199796), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:20,358 INFO [Listener at localhost/36443] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40639 2023-02-07 15:03:20,367 WARN [Listener at localhost/42617] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:20,466 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf560b61d76139742: Processing first storage report for DS-29212808-e6e8-4631-a437-b4a98a542afe from datanode cfb5898d-f79d-4d62-b442-1dcf7c279eb6 2023-02-07 15:03:20,466 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf560b61d76139742: from storage DS-29212808-e6e8-4631-a437-b4a98a542afe node DatanodeRegistration(127.0.0.1:40379, datanodeUuid=cfb5898d-f79d-4d62-b442-1dcf7c279eb6, infoPort=46195, infoSecurePort=0, ipcPort=42617, storageInfo=lv=-57;cid=testClusterID;nsid=963834926;c=1675782199796), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:20,466 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf560b61d76139742: Processing first storage report for DS-7dc2b838-56fe-42d4-8cc3-bf0d4a32d279 from datanode cfb5898d-f79d-4d62-b442-1dcf7c279eb6 2023-02-07 15:03:20,466 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf560b61d76139742: from storage DS-7dc2b838-56fe-42d4-8cc3-bf0d4a32d279 node DatanodeRegistration(127.0.0.1:40379, datanodeUuid=cfb5898d-f79d-4d62-b442-1dcf7c279eb6, infoPort=46195, infoSecurePort=0, ipcPort=42617, storageInfo=lv=-57;cid=testClusterID;nsid=963834926;c=1675782199796), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:20,475 DEBUG [Listener at localhost/42617] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5 2023-02-07 15:03:20,476 INFO [Listener at localhost/42617] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e/zookeeper_0, clientPort=50579, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 15:03:20,477 INFO [Listener at localhost/42617] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50579 2023-02-07 15:03:20,478 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,478 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,494 INFO [Listener at localhost/42617] util.FSUtils(479): Created version file at hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5 with version=8 2023-02-07 15:03:20,494 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,495 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,496 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/hbase-staging 2023-02-07 15:03:20,497 INFO [Listener at localhost/42617] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:20,498 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,498 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,498 INFO [Listener at localhost/42617] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:20,498 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,498 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:20,498 INFO [Listener at localhost/42617] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:20,500 INFO [Listener at localhost/42617] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44799 2023-02-07 15:03:20,501 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,501 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,502 INFO [Listener at localhost/42617] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44799 connecting to ZooKeeper ensemble=127.0.0.1:50579 2023-02-07 15:03:20,509 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:447990x0, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:20,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44799-0x1002f4f06610000 connected 2023-02-07 15:03:20,528 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:20,528 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:20,529 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:20,529 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44799 2023-02-07 15:03:20,529 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44799 2023-02-07 15:03:20,530 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44799 2023-02-07 15:03:20,532 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44799 2023-02-07 15:03:20,534 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44799 2023-02-07 15:03:20,534 INFO [Listener at localhost/42617] master.HMaster(439): hbase.rootdir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5, hbase.cluster.distributed=false 2023-02-07 15:03:20,546 INFO [Listener at localhost/42617] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:20,546 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,546 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,546 INFO [Listener at localhost/42617] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:20,546 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,546 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:20,547 INFO [Listener at localhost/42617] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:20,547 INFO [Listener at localhost/42617] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40501 2023-02-07 15:03:20,547 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:20,549 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:20,549 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,550 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,551 INFO [Listener at localhost/42617] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40501 connecting to ZooKeeper ensemble=127.0.0.1:50579 2023-02-07 15:03:20,554 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:405010x0, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:20,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40501-0x1002f4f06610001 connected 2023-02-07 15:03:20,555 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:20,556 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:20,556 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:20,560 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40501 2023-02-07 15:03:20,560 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40501 2023-02-07 15:03:20,560 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40501 2023-02-07 15:03:20,561 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40501 2023-02-07 15:03:20,562 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40501 2023-02-07 15:03:20,573 INFO [Listener at localhost/42617] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:20,573 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,573 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,573 INFO [Listener at localhost/42617] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:20,573 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:20,573 INFO [Listener at localhost/42617] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:20,573 INFO [Listener at localhost/42617] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:20,574 INFO [Listener at localhost/42617] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34587 2023-02-07 15:03:20,574 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:20,575 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:20,575 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,576 INFO [Listener at localhost/42617] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,577 INFO [Listener at localhost/42617] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34587 connecting to ZooKeeper ensemble=127.0.0.1:50579 2023-02-07 15:03:20,580 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:345870x0, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:20,581 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): regionserver:345870x0, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:20,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34587-0x1002f4f06610002 connected 2023-02-07 15:03:20,582 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:20,582 DEBUG [Listener at localhost/42617] zookeeper.ZKUtil(164): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:20,582 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34587 2023-02-07 15:03:20,584 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34587 2023-02-07 15:03:20,585 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34587 2023-02-07 15:03:20,585 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34587 2023-02-07 15:03:20,585 DEBUG [Listener at localhost/42617] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34587 2023-02-07 15:03:20,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:20,588 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:20,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:20,590 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:20,590 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:20,590 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:20,590 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:20,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:20,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44799,1675782200497 from backup master directory 2023-02-07 15:03:20,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:20,593 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:20,593 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:20,593 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:20,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:20,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/hbase.id with ID: 55ad923d-4a56-4c78-b89c-47073c2ba01e 2023-02-07 15:03:20,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:20,622 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:20,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0bce7662 to 127.0.0.1:50579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:20,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@782f1b5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:20,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:20,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 15:03:20,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:20,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store-tmp 2023-02-07 15:03:20,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:20,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:20,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:20,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:20,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:20,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:20,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:20,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782200650Disabling compacts and flushes for region at 1675782200650Disabling writes for close at 1675782200650Writing region close event to WAL at 1675782200650Closed at 1675782200650 2023-02-07 15:03:20,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/WALs/jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:20,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44799%2C1675782200497, suffix=, logDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/WALs/jenkins-hbase4.apache.org,44799,1675782200497, archiveDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/oldWALs, maxLogs=10 2023-02-07 15:03:20,668 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK] 2023-02-07 15:03:20,668 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK] 2023-02-07 15:03:20,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/WALs/jenkins-hbase4.apache.org,44799,1675782200497/jenkins-hbase4.apache.org%2C44799%2C1675782200497.1675782200654 2023-02-07 15:03:20,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK], DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK]] 2023-02-07 15:03:20,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:20,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:20,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:20,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:20,673 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:20,674 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 15:03:20,674 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 15:03:20,675 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:20,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:20,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:20,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:20,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:20,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62567882, jitterRate=-0.06766590476036072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:20,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675782200671Initializing all the Stores at 1675782200671Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782200671Cleaning up temporary data from old regions at 1675782200677 (+6 ms)Cleaning up detritus from prior splits at 1675782200677Region opened successfully at 1675782200682 (+5 ms) 2023-02-07 15:03:20,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 15:03:20,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 15:03:20,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 15:03:20,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 15:03:20,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 15:03:20,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 15:03:20,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 15:03:20,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 15:03:20,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 15:03:20,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 15:03:20,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 15:03:20,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 15:03:20,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 15:03:20,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 15:03:20,702 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:20,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 15:03:20,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 15:03:20,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 15:03:20,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:20,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:20,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:20,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:20,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44799,1675782200497, sessionid=0x1002f4f06610000, setting cluster-up flag (Was=false) 2023-02-07 15:03:20,712 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:20,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 15:03:20,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:20,720 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:20,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 15:03:20,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:20,726 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.hbase-snapshot/.tmp 2023-02-07 15:03:20,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:20,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675782230741 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 15:03:20,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,743 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:20,743 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 15:03:20,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 15:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 15:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 15:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 15:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 15:03:20,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782200744,5,FailOnTimeoutGroup] 2023-02-07 15:03:20,744 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:20,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782200744,5,FailOnTimeoutGroup] 2023-02-07 15:03:20,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 15:03:20,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,755 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:20,755 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:20,755 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5 2023-02-07 15:03:20,761 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:20,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:20,764 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/info 2023-02-07 15:03:20,764 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:20,765 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:20,765 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:20,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:20,766 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:20,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:20,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:20,768 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/table 2023-02-07 15:03:20,768 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:20,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:20,769 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740 2023-02-07 15:03:20,770 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740 2023-02-07 15:03:20,772 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:20,773 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:20,774 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:20,775 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73765601, jitterRate=0.09919311106204987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:20,775 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675782200762Initializing all the Stores at 1675782200762Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782200762Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782200762Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782200762Cleaning up temporary data from old regions at 1675782200771 (+9 ms)Cleaning up detritus from prior splits at 1675782200771Region opened successfully at 1675782200775 (+4 ms) 2023-02-07 15:03:20,775 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:20,775 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:20,775 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:20,775 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:20,775 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:20,775 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:20,775 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782200775Disabling compacts and flushes for region at 1675782200775Disabling writes for close at 1675782200775Writing region close event to WAL at 1675782200775Closed at 1675782200775 2023-02-07 15:03:20,776 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:20,776 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 15:03:20,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 15:03:20,777 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 15:03:20,779 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 15:03:20,787 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(952): ClusterId : 55ad923d-4a56-4c78-b89c-47073c2ba01e 2023-02-07 15:03:20,787 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(952): ClusterId : 55ad923d-4a56-4c78-b89c-47073c2ba01e 2023-02-07 15:03:20,787 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:20,787 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:20,789 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:20,789 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:20,789 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:20,789 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:20,791 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:20,791 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:20,793 DEBUG [RS:1;jenkins-hbase4:34587] zookeeper.ReadOnlyZKClient(139): Connect 0x08acd93f to 127.0.0.1:50579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:20,793 DEBUG [RS:0;jenkins-hbase4:40501] zookeeper.ReadOnlyZKClient(139): Connect 0x665b7fd1 to 127.0.0.1:50579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:20,800 DEBUG [RS:0;jenkins-hbase4:40501] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@689c9d6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:20,800 DEBUG [RS:1;jenkins-hbase4:34587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66b365a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:20,800 DEBUG [RS:0;jenkins-hbase4:40501] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ca314a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:20,800 DEBUG [RS:1;jenkins-hbase4:34587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@254b24f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:20,808 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40501 2023-02-07 15:03:20,808 INFO [RS:0;jenkins-hbase4:40501] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:20,808 INFO [RS:0;jenkins-hbase4:40501] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:20,808 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:20,809 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34587 2023-02-07 15:03:20,809 INFO [RS:1;jenkins-hbase4:34587] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:20,809 INFO [RS:1;jenkins-hbase4:34587] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:20,809 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:20,809 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44799,1675782200497 with isa=jenkins-hbase4.apache.org/172.31.14.131:40501, startcode=1675782200546 2023-02-07 15:03:20,809 DEBUG [RS:0;jenkins-hbase4:40501] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:20,809 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44799,1675782200497 with isa=jenkins-hbase4.apache.org/172.31.14.131:34587, startcode=1675782200572 2023-02-07 15:03:20,809 DEBUG [RS:1;jenkins-hbase4:34587] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:20,811 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50029, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:20,812 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43961, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:20,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:20,813 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44799] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:20,814 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5 2023-02-07 15:03:20,814 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5 2023-02-07 15:03:20,814 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35559 2023-02-07 15:03:20,814 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35559 2023-02-07 15:03:20,814 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:20,814 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:20,818 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:20,818 DEBUG [RS:1;jenkins-hbase4:34587] zookeeper.ZKUtil(162): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:20,818 DEBUG [RS:0;jenkins-hbase4:40501] zookeeper.ZKUtil(162): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:20,819 WARN [RS:1;jenkins-hbase4:34587] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:20,819 WARN [RS:0;jenkins-hbase4:40501] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:20,819 INFO [RS:1;jenkins-hbase4:34587] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:20,819 INFO [RS:0;jenkins-hbase4:40501] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:20,819 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:20,819 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:20,819 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40501,1675782200546] 2023-02-07 15:03:20,819 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34587,1675782200572] 2023-02-07 15:03:20,827 DEBUG [RS:1;jenkins-hbase4:34587] zookeeper.ZKUtil(162): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:20,827 DEBUG [RS:0;jenkins-hbase4:40501] zookeeper.ZKUtil(162): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:20,828 DEBUG [RS:1;jenkins-hbase4:34587] zookeeper.ZKUtil(162): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:20,828 DEBUG [RS:0;jenkins-hbase4:40501] zookeeper.ZKUtil(162): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:20,829 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:20,829 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:20,829 INFO [RS:1;jenkins-hbase4:34587] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:20,829 INFO [RS:0;jenkins-hbase4:40501] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:20,832 INFO [RS:1;jenkins-hbase4:34587] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:20,832 INFO [RS:0;jenkins-hbase4:40501] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:20,832 INFO [RS:1;jenkins-hbase4:34587] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:20,832 INFO [RS:1;jenkins-hbase4:34587] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,832 INFO [RS:0;jenkins-hbase4:40501] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:20,832 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:20,832 INFO [RS:0;jenkins-hbase4:40501] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,833 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:20,834 INFO [RS:1;jenkins-hbase4:34587] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,834 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,834 INFO [RS:0;jenkins-hbase4:40501] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,834 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,834 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,834 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,834 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,834 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,834 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:20,835 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:20,835 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:1;jenkins-hbase4:34587] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,835 DEBUG [RS:0;jenkins-hbase4:40501] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:20,840 INFO [RS:1;jenkins-hbase4:34587] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,840 INFO [RS:1;jenkins-hbase4:34587] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,840 INFO [RS:0;jenkins-hbase4:40501] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,840 INFO [RS:1;jenkins-hbase4:34587] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,841 INFO [RS:0;jenkins-hbase4:40501] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,841 INFO [RS:0;jenkins-hbase4:40501] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,853 INFO [RS:0;jenkins-hbase4:40501] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:20,853 INFO [RS:0;jenkins-hbase4:40501] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40501,1675782200546-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,858 INFO [RS:1;jenkins-hbase4:34587] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:20,858 INFO [RS:1;jenkins-hbase4:34587] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34587,1675782200572-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:20,870 INFO [RS:0;jenkins-hbase4:40501] regionserver.Replication(203): jenkins-hbase4.apache.org,40501,1675782200546 started 2023-02-07 15:03:20,870 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40501,1675782200546, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40501, sessionid=0x1002f4f06610001 2023-02-07 15:03:20,870 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:20,870 DEBUG [RS:0;jenkins-hbase4:40501] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:20,870 DEBUG [RS:0;jenkins-hbase4:40501] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40501,1675782200546' 2023-02-07 15:03:20,870 DEBUG [RS:0;jenkins-hbase4:40501] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:20,871 DEBUG [RS:0;jenkins-hbase4:40501] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:20,871 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:20,871 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:20,871 DEBUG [RS:0;jenkins-hbase4:40501] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:20,871 DEBUG [RS:0;jenkins-hbase4:40501] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40501,1675782200546' 2023-02-07 15:03:20,871 DEBUG [RS:0;jenkins-hbase4:40501] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:20,872 DEBUG [RS:0;jenkins-hbase4:40501] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:20,872 DEBUG [RS:0;jenkins-hbase4:40501] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:20,872 INFO [RS:0;jenkins-hbase4:40501] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:20,872 INFO [RS:0;jenkins-hbase4:40501] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:20,874 INFO [RS:1;jenkins-hbase4:34587] regionserver.Replication(203): jenkins-hbase4.apache.org,34587,1675782200572 started 2023-02-07 15:03:20,874 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34587,1675782200572, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34587, sessionid=0x1002f4f06610002 2023-02-07 15:03:20,874 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:20,874 DEBUG [RS:1;jenkins-hbase4:34587] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:20,874 DEBUG [RS:1;jenkins-hbase4:34587] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34587,1675782200572' 2023-02-07 15:03:20,874 DEBUG [RS:1;jenkins-hbase4:34587] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:20,874 DEBUG [RS:1;jenkins-hbase4:34587] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:20,875 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:20,875 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:20,875 DEBUG [RS:1;jenkins-hbase4:34587] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:20,875 DEBUG [RS:1;jenkins-hbase4:34587] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34587,1675782200572' 2023-02-07 15:03:20,875 DEBUG [RS:1;jenkins-hbase4:34587] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:20,875 DEBUG [RS:1;jenkins-hbase4:34587] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:20,875 DEBUG [RS:1;jenkins-hbase4:34587] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:20,875 INFO [RS:1;jenkins-hbase4:34587] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:20,875 INFO [RS:1;jenkins-hbase4:34587] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:20,929 DEBUG [jenkins-hbase4:44799] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 15:03:20,929 DEBUG [jenkins-hbase4:44799] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:20,931 DEBUG [jenkins-hbase4:44799] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:20,931 DEBUG [jenkins-hbase4:44799] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:20,931 DEBUG [jenkins-hbase4:44799] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:20,932 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40501,1675782200546, state=OPENING 2023-02-07 15:03:20,933 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 15:03:20,935 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:20,936 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:20,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:21,090 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:21,090 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:21,092 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44172, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:21,096 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 15:03:21,096 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:21,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40501%2C1675782200546.meta, suffix=.meta, logDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,40501,1675782200546, archiveDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/oldWALs, maxLogs=32 2023-02-07 15:03:21,114 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK] 2023-02-07 15:03:21,114 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK] 2023-02-07 15:03:21,116 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,40501,1675782200546/jenkins-hbase4.apache.org%2C40501%2C1675782200546.meta.1675782201098.meta 2023-02-07 15:03:21,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK], DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK]] 2023-02-07 15:03:21,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:21,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 15:03:21,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 15:03:21,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 15:03:21,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 15:03:21,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 15:03:21,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 15:03:21,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:21,119 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/info 2023-02-07 15:03:21,119 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/info 2023-02-07 15:03:21,119 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:21,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:21,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:21,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:21,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:21,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:21,121 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:21,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:21,122 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/table 2023-02-07 15:03:21,122 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/table 2023-02-07 15:03:21,122 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:21,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:21,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740 2023-02-07 15:03:21,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740 2023-02-07 15:03:21,126 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:21,127 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:21,128 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61164095, jitterRate=-0.08858396112918854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:21,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675782201117Writing region info on filesystem at 1675782201117Initializing all the Stores at 1675782201118 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782201118Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782201118Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782201118Cleaning up temporary data from old regions at 1675782201125 (+7 ms)Cleaning up detritus from prior splits at 1675782201125Running coprocessor post-open hooks at 1675782201128 (+3 ms)Region opened successfully at 1675782201128 2023-02-07 15:03:21,128 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675782201090 2023-02-07 15:03:21,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 15:03:21,133 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 15:03:21,134 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40501,1675782200546, state=OPEN 2023-02-07 15:03:21,135 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 15:03:21,135 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:21,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 15:03:21,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40501,1675782200546 in 199 msec 2023-02-07 15:03:21,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 15:03:21,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-07 15:03:21,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 411 msec 2023-02-07 15:03:21,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675782200589, completionTime=-1 2023-02-07 15:03:21,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 15:03:21,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 15:03:21,143 DEBUG [hconnection-0x3ad2c906-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:21,145 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:21,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 15:03:21,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675782261147 2023-02-07 15:03:21,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675782321147 2023-02-07 15:03:21,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-07 15:03:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44799,1675782200497-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44799,1675782200497-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44799,1675782200497-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44799, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 15:03:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:21,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 15:03:21,157 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 15:03:21,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:21,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:21,160 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,160 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66 empty. 2023-02-07 15:03:21,161 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,161 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 15:03:21,170 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:21,173 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d0850efa5840b80788bb42a012a34b66, NAME => 'hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,181 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,181 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d0850efa5840b80788bb42a012a34b66, disabling compactions & flushes 2023-02-07 15:03:21,181 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:21,181 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:21,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. after waiting 0 ms 2023-02-07 15:03:21,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:21,182 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:21,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d0850efa5840b80788bb42a012a34b66: Waiting for close lock at 1675782201181Disabling compacts and flushes for region at 1675782201181Disabling writes for close at 1675782201182 (+1 ms)Writing region close event to WAL at 1675782201182Closed at 1675782201182 2023-02-07 15:03:21,184 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:21,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782201185"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782201185"}]},"ts":"1675782201185"} 2023-02-07 15:03:21,187 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:21,188 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:21,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782201188"}]},"ts":"1675782201188"} 2023-02-07 15:03:21,190 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 15:03:21,195 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:21,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:21,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:21,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:21,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d0850efa5840b80788bb42a012a34b66, ASSIGN}] 2023-02-07 15:03:21,202 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d0850efa5840b80788bb42a012a34b66, ASSIGN 2023-02-07 15:03:21,203 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d0850efa5840b80788bb42a012a34b66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34587,1675782200572; forceNewPlan=false, retain=false 2023-02-07 15:03:21,354 INFO [jenkins-hbase4:44799] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:21,355 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d0850efa5840b80788bb42a012a34b66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:21,355 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782201355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782201355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782201355"}]},"ts":"1675782201355"} 2023-02-07 15:03:21,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d0850efa5840b80788bb42a012a34b66, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:21,510 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:21,510 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:21,512 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:21,518 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:21,519 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34587%2C1675782200572, suffix=, logDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,34587,1675782200572, archiveDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/oldWALs, maxLogs=32 2023-02-07 15:03:21,533 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK] 2023-02-07 15:03:21,533 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK] 2023-02-07 15:03:21,535 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,34587,1675782200572/jenkins-hbase4.apache.org%2C34587%2C1675782200572.1675782201520 2023-02-07 15:03:21,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK], DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK]] 2023-02-07 15:03:21,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d0850efa5840b80788bb42a012a34b66, NAME => 'hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:21,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,540 INFO [StoreOpener-d0850efa5840b80788bb42a012a34b66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,542 DEBUG [StoreOpener-d0850efa5840b80788bb42a012a34b66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/info 2023-02-07 15:03:21,542 DEBUG [StoreOpener-d0850efa5840b80788bb42a012a34b66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/info 2023-02-07 15:03:21,542 INFO [StoreOpener-d0850efa5840b80788bb42a012a34b66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0850efa5840b80788bb42a012a34b66 columnFamilyName info 2023-02-07 15:03:21,543 INFO [StoreOpener-d0850efa5840b80788bb42a012a34b66-1] regionserver.HStore(310): Store=d0850efa5840b80788bb42a012a34b66/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:21,543 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:21,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:21,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d0850efa5840b80788bb42a012a34b66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60042798, jitterRate=-0.10529258847236633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:21,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d0850efa5840b80788bb42a012a34b66: Running coprocessor pre-open hook at 1675782201536Writing region info on filesystem at 1675782201536Initializing all the Stores at 1675782201536Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782201536Cleaning up temporary data from old regions at 1675782201544 (+8 ms)Cleaning up detritus from prior splits at 1675782201545 (+1 ms)Running coprocessor post-open hooks at 1675782201550 (+5 ms)Region opened successfully at 1675782201550 2023-02-07 15:03:21,551 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66., pid=6, masterSystemTime=1675782201510 2023-02-07 15:03:21,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d0850efa5840b80788bb42a012a34b66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:21,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782201555"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782201555"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782201555"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782201555"}]},"ts":"1675782201555"} 2023-02-07 15:03:21,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:21,556 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:21,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 15:03:21,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d0850efa5840b80788bb42a012a34b66, server=jenkins-hbase4.apache.org,34587,1675782200572 in 200 msec 2023-02-07 15:03:21,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 15:03:21,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d0850efa5840b80788bb42a012a34b66, ASSIGN in 363 msec 2023-02-07 15:03:21,561 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:21,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782201561"}]},"ts":"1675782201561"} 2023-02-07 15:03:21,563 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 15:03:21,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:21,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 409 msec 2023-02-07 15:03:21,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 15:03:21,659 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:21,659 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:21,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:21,663 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:21,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 15:03:21,676 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:21,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-07 15:03:21,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 15:03:21,694 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:21,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-07 15:03:21,702 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 15:03:21,704 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 15:03:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.111sec 2023-02-07 15:03:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 15:03:21,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 15:03:21,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 15:03:21,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44799,1675782200497-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 15:03:21,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44799,1675782200497-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 15:03:21,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 15:03:21,721 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 15:03:21,788 DEBUG [Listener at localhost/42617] zookeeper.ReadOnlyZKClient(139): Connect 0x081b8317 to 127.0.0.1:50579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:21,797 DEBUG [Listener at localhost/42617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40531db7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:21,805 DEBUG [hconnection-0x25711d63-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:21,812 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44202, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:21,816 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:21,816 DEBUG [Listener at localhost/42617] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 15:03:21,816 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:21,816 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:21,818 DEBUG [Listener at localhost/42617] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 15:03:21,822 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37856, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 15:03:21,823 INFO [Listener at localhost/42617] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-07 15:03:21,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-07 15:03:21,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 15:03:21,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:37856 deadline: 1675782261823, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-07 15:03:21,824 INFO [Listener at localhost/42617] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-07 15:03:21,824 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:21,824 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:21,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:21,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:21,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:21,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-07 15:03:21,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:21,830 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:21,831 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:21,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:21,838 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:21,838 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:21,838 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:21,839 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:21,838 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:21,839 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:21,839 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:21,839 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e empty. 2023-02-07 15:03:21,838 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:21,839 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747 empty. 2023-02-07 15:03:21,839 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465 empty. 2023-02-07 15:03:21,840 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce empty. 2023-02-07 15:03:21,840 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:21,840 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714 empty. 2023-02-07 15:03:21,840 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:21,840 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304 empty. 2023-02-07 15:03:21,840 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58 empty. 2023-02-07 15:03:21,841 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef empty. 2023-02-07 15:03:21,841 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:21,841 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:21,841 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:21,841 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:21,841 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:21,841 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857 empty. 2023-02-07 15:03:21,842 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:21,842 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2 empty. 2023-02-07 15:03:21,842 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:21,842 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:21,842 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:21,842 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:21,842 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-07 15:03:21,855 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:21,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 124c6c7d3f7a07c87266dcbcd5922857, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 22bba9af64d7162ee33e53974dde6f1e, NAME => 'testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9c2e037e417bc7fcf13f24e7af86bbce, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 124c6c7d3f7a07c87266dcbcd5922857, disabling compactions & flushes 2023-02-07 15:03:21,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:21,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:21,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. after waiting 0 ms 2023-02-07 15:03:21,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:21,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:21,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 124c6c7d3f7a07c87266dcbcd5922857: Waiting for close lock at 1675782201870Disabling compacts and flushes for region at 1675782201870Disabling writes for close at 1675782201870Writing region close event to WAL at 1675782201870Closed at 1675782201870 2023-02-07 15:03:21,871 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,871 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6abc99196eeaac57d24e398f1a94e304, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,871 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 22bba9af64d7162ee33e53974dde6f1e, disabling compactions & flushes 2023-02-07 15:03:21,871 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:21,871 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:21,871 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. after waiting 0 ms 2023-02-07 15:03:21,871 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:21,871 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:21,871 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 22bba9af64d7162ee33e53974dde6f1e: Waiting for close lock at 1675782201871Disabling compacts and flushes for region at 1675782201871Disabling writes for close at 1675782201871Writing region close event to WAL at 1675782201871Closed at 1675782201871 2023-02-07 15:03:21,872 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ef20cfe0da07f5897e599c734db8eb58, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,874 INFO [RS:0;jenkins-hbase4:40501] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40501%2C1675782200546, suffix=, logDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,40501,1675782200546, archiveDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/oldWALs, maxLogs=32 2023-02-07 15:03:21,890 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,890 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing ef20cfe0da07f5897e599c734db8eb58, disabling compactions & flushes 2023-02-07 15:03:21,891 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. after waiting 0 ms 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:21,891 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for ef20cfe0da07f5897e599c734db8eb58: Waiting for close lock at 1675782201890Disabling compacts and flushes for region at 1675782201890Disabling writes for close at 1675782201891 (+1 ms)Writing region close event to WAL at 1675782201891Closed at 1675782201891 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,891 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => f5a441015f7aec14f7fc86d53bcdd714, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 6abc99196eeaac57d24e398f1a94e304, disabling compactions & flushes 2023-02-07 15:03:21,891 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:21,891 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. after waiting 0 ms 2023-02-07 15:03:21,892 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:21,892 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:21,892 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 6abc99196eeaac57d24e398f1a94e304: Waiting for close lock at 1675782201891Disabling compacts and flushes for region at 1675782201891Disabling writes for close at 1675782201892 (+1 ms)Writing region close event to WAL at 1675782201892Closed at 1675782201892 2023-02-07 15:03:21,892 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => de4dd0cd409fe4d62ad5aeb9c63d3465, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,892 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK] 2023-02-07 15:03:21,892 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK] 2023-02-07 15:03:21,896 INFO [RS:0;jenkins-hbase4:40501] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/WALs/jenkins-hbase4.apache.org,40501,1675782200546/jenkins-hbase4.apache.org%2C40501%2C1675782200546.1675782201875 2023-02-07 15:03:21,897 DEBUG [RS:0;jenkins-hbase4:40501] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40379,DS-29212808-e6e8-4631-a437-b4a98a542afe,DISK], DatanodeInfoWithStorage[127.0.0.1:43277,DS-a69a5b81-cca6-415e-b46e-eb6caccc2535,DISK]] 2023-02-07 15:03:21,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,907 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing f5a441015f7aec14f7fc86d53bcdd714, disabling compactions & flushes 2023-02-07 15:03:21,907 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:21,907 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:21,907 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. after waiting 0 ms 2023-02-07 15:03:21,907 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:21,907 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:21,907 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for f5a441015f7aec14f7fc86d53bcdd714: Waiting for close lock at 1675782201907Disabling compacts and flushes for region at 1675782201907Disabling writes for close at 1675782201907Writing region close event to WAL at 1675782201907Closed at 1675782201907 2023-02-07 15:03:21,907 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b0c7e502cc37c83c904b4a8353af2747, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,908 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing de4dd0cd409fe4d62ad5aeb9c63d3465, disabling compactions & flushes 2023-02-07 15:03:21,909 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:21,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:21,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. after waiting 0 ms 2023-02-07 15:03:21,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:21,909 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:21,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for de4dd0cd409fe4d62ad5aeb9c63d3465: Waiting for close lock at 1675782201909Disabling compacts and flushes for region at 1675782201909Disabling writes for close at 1675782201909Writing region close event to WAL at 1675782201909Closed at 1675782201909 2023-02-07 15:03:21,909 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7cc3bd9568047197cbcc41737dccbcef, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b0c7e502cc37c83c904b4a8353af2747, disabling compactions & flushes 2023-02-07 15:03:21,916 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:21,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:21,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. after waiting 0 ms 2023-02-07 15:03:21,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:21,916 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:21,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b0c7e502cc37c83c904b4a8353af2747: Waiting for close lock at 1675782201916Disabling compacts and flushes for region at 1675782201916Disabling writes for close at 1675782201916Writing region close event to WAL at 1675782201916Closed at 1675782201916 2023-02-07 15:03:21,917 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 74192f33ac005cdd568f16ce85f8d2c2, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp 2023-02-07 15:03:21,919 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,919 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 7cc3bd9568047197cbcc41737dccbcef, disabling compactions & flushes 2023-02-07 15:03:21,919 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:21,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:21,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. after waiting 0 ms 2023-02-07 15:03:21,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:21,920 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:21,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 7cc3bd9568047197cbcc41737dccbcef: Waiting for close lock at 1675782201919Disabling compacts and flushes for region at 1675782201919Disabling writes for close at 1675782201920 (+1 ms)Writing region close event to WAL at 1675782201920Closed at 1675782201920 2023-02-07 15:03:21,924 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:21,924 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 74192f33ac005cdd568f16ce85f8d2c2, disabling compactions & flushes 2023-02-07 15:03:21,924 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:21,924 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:21,924 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. after waiting 0 ms 2023-02-07 15:03:21,924 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:21,924 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:21,924 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 74192f33ac005cdd568f16ce85f8d2c2: Waiting for close lock at 1675782201924Disabling compacts and flushes for region at 1675782201924Disabling writes for close at 1675782201924Writing region close event to WAL at 1675782201924Closed at 1675782201924 2023-02-07 15:03:21,932 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:21,932 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:21,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:22,134 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:22,134 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:22,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:22,273 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,274 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 9c2e037e417bc7fcf13f24e7af86bbce, disabling compactions & flushes 2023-02-07 15:03:22,274 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:22,274 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:22,274 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. after waiting 0 ms 2023-02-07 15:03:22,274 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:22,274 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:22,274 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 9c2e037e417bc7fcf13f24e7af86bbce: Waiting for close lock at 1675782202274Disabling compacts and flushes for region at 1675782202274Disabling writes for close at 1675782202274Writing region close event to WAL at 1675782202274Closed at 1675782202274 2023-02-07 15:03:22,276 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:22,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782202277"}]},"ts":"1675782202277"} 2023-02-07 15:03:22,280 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 15:03:22,281 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:22,281 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782202281"}]},"ts":"1675782202281"} 2023-02-07 15:03:22,282 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-07 15:03:22,284 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:22,290 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:22,290 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:22,290 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:22,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=22bba9af64d7162ee33e53974dde6f1e, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=124c6c7d3f7a07c87266dcbcd5922857, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9c2e037e417bc7fcf13f24e7af86bbce, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6abc99196eeaac57d24e398f1a94e304, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef20cfe0da07f5897e599c734db8eb58, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5a441015f7aec14f7fc86d53bcdd714, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de4dd0cd409fe4d62ad5aeb9c63d3465, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0c7e502cc37c83c904b4a8353af2747, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cc3bd9568047197cbcc41737dccbcef, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=74192f33ac005cdd568f16ce85f8d2c2, ASSIGN}] 2023-02-07 15:03:22,293 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=124c6c7d3f7a07c87266dcbcd5922857, ASSIGN 2023-02-07 15:03:22,293 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=22bba9af64d7162ee33e53974dde6f1e, ASSIGN 2023-02-07 15:03:22,293 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=74192f33ac005cdd568f16ce85f8d2c2, ASSIGN 2023-02-07 15:03:22,293 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cc3bd9568047197cbcc41737dccbcef, ASSIGN 2023-02-07 15:03:22,294 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0c7e502cc37c83c904b4a8353af2747, ASSIGN 2023-02-07 15:03:22,294 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=22bba9af64d7162ee33e53974dde6f1e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34587,1675782200572; forceNewPlan=false, retain=false 2023-02-07 15:03:22,294 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=124c6c7d3f7a07c87266dcbcd5922857, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40501,1675782200546; forceNewPlan=false, retain=false 2023-02-07 15:03:22,294 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=74192f33ac005cdd568f16ce85f8d2c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40501,1675782200546; forceNewPlan=false, retain=false 2023-02-07 15:03:22,294 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cc3bd9568047197cbcc41737dccbcef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34587,1675782200572; forceNewPlan=false, retain=false 2023-02-07 15:03:22,295 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0c7e502cc37c83c904b4a8353af2747, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40501,1675782200546; forceNewPlan=false, retain=false 2023-02-07 15:03:22,295 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5a441015f7aec14f7fc86d53bcdd714, ASSIGN 2023-02-07 15:03:22,295 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de4dd0cd409fe4d62ad5aeb9c63d3465, ASSIGN 2023-02-07 15:03:22,295 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef20cfe0da07f5897e599c734db8eb58, ASSIGN 2023-02-07 15:03:22,295 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6abc99196eeaac57d24e398f1a94e304, ASSIGN 2023-02-07 15:03:22,295 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9c2e037e417bc7fcf13f24e7af86bbce, ASSIGN 2023-02-07 15:03:22,295 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5a441015f7aec14f7fc86d53bcdd714, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40501,1675782200546; forceNewPlan=false, retain=false 2023-02-07 15:03:22,295 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de4dd0cd409fe4d62ad5aeb9c63d3465, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34587,1675782200572; forceNewPlan=false, retain=false 2023-02-07 15:03:22,296 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef20cfe0da07f5897e599c734db8eb58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40501,1675782200546; forceNewPlan=false, retain=false 2023-02-07 15:03:22,296 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6abc99196eeaac57d24e398f1a94e304, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34587,1675782200572; forceNewPlan=false, retain=false 2023-02-07 15:03:22,296 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9c2e037e417bc7fcf13f24e7af86bbce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34587,1675782200572; forceNewPlan=false, retain=false 2023-02-07 15:03:22,436 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:22,436 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:22,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:22,444 INFO [jenkins-hbase4:44799] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 15:03:22,451 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ef20cfe0da07f5897e599c734db8eb58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=124c6c7d3f7a07c87266dcbcd5922857, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,451 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b0c7e502cc37c83c904b4a8353af2747, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,451 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f5a441015f7aec14f7fc86d53bcdd714, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,451 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=74192f33ac005cdd568f16ce85f8d2c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,451 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202450"}]},"ts":"1675782202450"} 2023-02-07 15:03:22,451 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202451"}]},"ts":"1675782202451"} 2023-02-07 15:03:22,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202450"}]},"ts":"1675782202450"} 2023-02-07 15:03:22,451 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202451"}]},"ts":"1675782202451"} 2023-02-07 15:03:22,451 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782202450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202450"}]},"ts":"1675782202450"} 2023-02-07 15:03:22,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure f5a441015f7aec14f7fc86d53bcdd714, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:22,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure b0c7e502cc37c83c904b4a8353af2747, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:22,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 124c6c7d3f7a07c87266dcbcd5922857, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:22,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure ef20cfe0da07f5897e599c734db8eb58, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:22,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 74192f33ac005cdd568f16ce85f8d2c2, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:22,457 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7cc3bd9568047197cbcc41737dccbcef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,457 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202457"}]},"ts":"1675782202457"} 2023-02-07 15:03:22,458 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9c2e037e417bc7fcf13f24e7af86bbce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,458 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=22bba9af64d7162ee33e53974dde6f1e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,458 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782202458"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202458"}]},"ts":"1675782202458"} 2023-02-07 15:03:22,458 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202458"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202458"}]},"ts":"1675782202458"} 2023-02-07 15:03:22,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure 7cc3bd9568047197cbcc41737dccbcef, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:22,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=de4dd0cd409fe4d62ad5aeb9c63d3465, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202459"}]},"ts":"1675782202459"} 2023-02-07 15:03:22,460 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6abc99196eeaac57d24e398f1a94e304, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 22bba9af64d7162ee33e53974dde6f1e, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:22,460 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202460"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782202460"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782202460"}]},"ts":"1675782202460"} 2023-02-07 15:03:22,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 9c2e037e417bc7fcf13f24e7af86bbce, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:22,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure de4dd0cd409fe4d62ad5aeb9c63d3465, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:22,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 6abc99196eeaac57d24e398f1a94e304, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:22,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:22,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f5a441015f7aec14f7fc86d53bcdd714, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 15:03:22,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,611 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,613 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1 2023-02-07 15:03:22,613 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1 2023-02-07 15:03:22,613 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5a441015f7aec14f7fc86d53bcdd714 columnFamilyName f1 2023-02-07 15:03:22,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:22,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 22bba9af64d7162ee33e53974dde6f1e, NAME => 'testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 15:03:22,614 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(310): Store=f5a441015f7aec14f7fc86d53bcdd714/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,614 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,615 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2 2023-02-07 15:03:22,616 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2 2023-02-07 15:03:22,616 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5a441015f7aec14f7fc86d53bcdd714 columnFamilyName f2 2023-02-07 15:03:22,616 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(310): Store=f5a441015f7aec14f7fc86d53bcdd714/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,619 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,620 DEBUG [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f1 2023-02-07 15:03:22,620 DEBUG [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f1 2023-02-07 15:03:22,621 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22bba9af64d7162ee33e53974dde6f1e columnFamilyName f1 2023-02-07 15:03:22,621 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(310): Store=22bba9af64d7162ee33e53974dde6f1e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,621 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,622 DEBUG [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f2 2023-02-07 15:03:22,622 DEBUG [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f2 2023-02-07 15:03:22,623 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22bba9af64d7162ee33e53974dde6f1e columnFamilyName f2 2023-02-07 15:03:22,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:22,623 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(310): Store=22bba9af64d7162ee33e53974dde6f1e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f5a441015f7aec14f7fc86d53bcdd714; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61742254, jitterRate=-0.07996872067451477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f5a441015f7aec14f7fc86d53bcdd714: Running coprocessor pre-open hook at 1675782202610Writing region info on filesystem at 1675782202610Initializing all the Stores at 1675782202611 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202611Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202611Cleaning up temporary data from old regions at 1675782202621 (+10 ms)Cleaning up detritus from prior splits at 1675782202621Running coprocessor post-open hooks at 1675782202625 (+4 ms)Region opened successfully at 1675782202625 2023-02-07 15:03:22,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714., pid=21, masterSystemTime=1675782202605 2023-02-07 15:03:22,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:22,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:22,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:22,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:22,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 124c6c7d3f7a07c87266dcbcd5922857, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 15:03:22,628 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f5a441015f7aec14f7fc86d53bcdd714, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,628 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202628"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202628"}]},"ts":"1675782202628"} 2023-02-07 15:03:22,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 22bba9af64d7162ee33e53974dde6f1e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73812128, jitterRate=0.09988641738891602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 22bba9af64d7162ee33e53974dde6f1e: Running coprocessor pre-open hook at 1675782202614Writing region info on filesystem at 1675782202614Initializing all the Stores at 1675782202615 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202615Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202619 (+4 ms)Cleaning up temporary data from old regions at 1675782202625 (+6 ms)Cleaning up detritus from prior splits at 1675782202625Running coprocessor post-open hooks at 1675782202629 (+4 ms)Region opened successfully at 1675782202629 2023-02-07 15:03:22,629 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e., pid=27, masterSystemTime=1675782202611 2023-02-07 15:03:22,631 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1 2023-02-07 15:03:22,631 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1 2023-02-07 15:03:22,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:22,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:22,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:22,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7cc3bd9568047197cbcc41737dccbcef, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 15:03:22,631 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 124c6c7d3f7a07c87266dcbcd5922857 columnFamilyName f1 2023-02-07 15:03:22,631 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=22bba9af64d7162ee33e53974dde6f1e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,632 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782202631"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202631"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202631"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202631"}]},"ts":"1675782202631"} 2023-02-07 15:03:22,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,632 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(310): Store=124c6c7d3f7a07c87266dcbcd5922857/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,632 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-07 15:03:22,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure f5a441015f7aec14f7fc86d53bcdd714, server=jenkins-hbase4.apache.org,40501,1675782200546 in 177 msec 2023-02-07 15:03:22,633 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5a441015f7aec14f7fc86d53bcdd714, ASSIGN in 341 msec 2023-02-07 15:03:22,634 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2 2023-02-07 15:03:22,634 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2 2023-02-07 15:03:22,634 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 124c6c7d3f7a07c87266dcbcd5922857 columnFamilyName f2 2023-02-07 15:03:22,634 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1 2023-02-07 15:03:22,634 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1 2023-02-07 15:03:22,635 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(310): Store=124c6c7d3f7a07c87266dcbcd5922857/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,635 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cc3bd9568047197cbcc41737dccbcef columnFamilyName f1 2023-02-07 15:03:22,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-07 15:03:22,635 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(310): Store=7cc3bd9568047197cbcc41737dccbcef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 22bba9af64d7162ee33e53974dde6f1e, server=jenkins-hbase4.apache.org,34587,1675782200572 in 174 msec 2023-02-07 15:03:22,635 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=22bba9af64d7162ee33e53974dde6f1e, ASSIGN in 344 msec 2023-02-07 15:03:22,636 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2 2023-02-07 15:03:22,637 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2 2023-02-07 15:03:22,637 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cc3bd9568047197cbcc41737dccbcef columnFamilyName f2 2023-02-07 15:03:22,637 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(310): Store=7cc3bd9568047197cbcc41737dccbcef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:22,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 124c6c7d3f7a07c87266dcbcd5922857; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61865125, jitterRate=-0.07813780009746552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 124c6c7d3f7a07c87266dcbcd5922857: Running coprocessor pre-open hook at 1675782202628Writing region info on filesystem at 1675782202628Initializing all the Stores at 1675782202629 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202629Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202629Cleaning up temporary data from old regions at 1675782202636 (+7 ms)Cleaning up detritus from prior splits at 1675782202637 (+1 ms)Running coprocessor post-open hooks at 1675782202641 (+4 ms)Region opened successfully at 1675782202641 2023-02-07 15:03:22,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:22,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857., pid=23, masterSystemTime=1675782202605 2023-02-07 15:03:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:22,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef20cfe0da07f5897e599c734db8eb58, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 15:03:22,643 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=124c6c7d3f7a07c87266dcbcd5922857, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,643 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202643"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202643"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202643"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202643"}]},"ts":"1675782202643"} 2023-02-07 15:03:22,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7cc3bd9568047197cbcc41737dccbcef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66818227, jitterRate=-0.004330828785896301}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7cc3bd9568047197cbcc41737dccbcef: Running coprocessor pre-open hook at 1675782202632Writing region info on filesystem at 1675782202632Initializing all the Stores at 1675782202633 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202633Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202633Cleaning up temporary data from old regions at 1675782202639 (+6 ms)Cleaning up detritus from prior splits at 1675782202639Running coprocessor post-open hooks at 1675782202643 (+4 ms)Region opened successfully at 1675782202643 2023-02-07 15:03:22,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef., pid=26, masterSystemTime=1675782202611 2023-02-07 15:03:22,645 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,647 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1 2023-02-07 15:03:22,647 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1 2023-02-07 15:03:22,647 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef20cfe0da07f5897e599c734db8eb58 columnFamilyName f1 2023-02-07 15:03:22,647 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(310): Store=ef20cfe0da07f5897e599c734db8eb58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,647 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:22,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:22,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:22,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => de4dd0cd409fe4d62ad5aeb9c63d3465, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 15:03:22,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7cc3bd9568047197cbcc41737dccbcef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202648"}]},"ts":"1675782202648"} 2023-02-07 15:03:22,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-07 15:03:22,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,649 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2 2023-02-07 15:03:22,649 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2 2023-02-07 15:03:22,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 124c6c7d3f7a07c87266dcbcd5922857, server=jenkins-hbase4.apache.org,40501,1675782200546 in 191 msec 2023-02-07 15:03:22,649 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef20cfe0da07f5897e599c734db8eb58 columnFamilyName f2 2023-02-07 15:03:22,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,650 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(310): Store=ef20cfe0da07f5897e599c734db8eb58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=124c6c7d3f7a07c87266dcbcd5922857, ASSIGN in 358 msec 2023-02-07 15:03:22,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-07 15:03:22,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure 7cc3bd9568047197cbcc41737dccbcef, server=jenkins-hbase4.apache.org,34587,1675782200572 in 192 msec 2023-02-07 15:03:22,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cc3bd9568047197cbcc41737dccbcef, ASSIGN in 361 msec 2023-02-07 15:03:22,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:22,656 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef20cfe0da07f5897e599c734db8eb58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69558765, jitterRate=0.03650636970996857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef20cfe0da07f5897e599c734db8eb58: Running coprocessor pre-open hook at 1675782202644Writing region info on filesystem at 1675782202644Initializing all the Stores at 1675782202645 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202645Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202645Cleaning up temporary data from old regions at 1675782202652 (+7 ms)Cleaning up detritus from prior splits at 1675782202652Running coprocessor post-open hooks at 1675782202657 (+5 ms)Region opened successfully at 1675782202657 2023-02-07 15:03:22,657 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1 2023-02-07 15:03:22,657 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1 2023-02-07 15:03:22,657 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de4dd0cd409fe4d62ad5aeb9c63d3465 columnFamilyName f1 2023-02-07 15:03:22,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58., pid=24, masterSystemTime=1675782202605 2023-02-07 15:03:22,658 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(310): Store=de4dd0cd409fe4d62ad5aeb9c63d3465/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,658 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:22,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:22,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b0c7e502cc37c83c904b4a8353af2747, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 15:03:22,659 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2 2023-02-07 15:03:22,659 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2 2023-02-07 15:03:22,659 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ef20cfe0da07f5897e599c734db8eb58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,659 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de4dd0cd409fe4d62ad5aeb9c63d3465 columnFamilyName f2 2023-02-07 15:03:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,659 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202659"}]},"ts":"1675782202659"} 2023-02-07 15:03:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,660 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(310): Store=de4dd0cd409fe4d62ad5aeb9c63d3465/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,661 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,662 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1 2023-02-07 15:03:22,662 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1 2023-02-07 15:03:22,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-07 15:03:22,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure ef20cfe0da07f5897e599c734db8eb58, server=jenkins-hbase4.apache.org,40501,1675782200546 in 205 msec 2023-02-07 15:03:22,662 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0c7e502cc37c83c904b4a8353af2747 columnFamilyName f1 2023-02-07 15:03:22,663 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(310): Store=b0c7e502cc37c83c904b4a8353af2747/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,663 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef20cfe0da07f5897e599c734db8eb58, ASSIGN in 371 msec 2023-02-07 15:03:22,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:22,665 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2 2023-02-07 15:03:22,665 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2 2023-02-07 15:03:22,665 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0c7e502cc37c83c904b4a8353af2747 columnFamilyName f2 2023-02-07 15:03:22,666 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(310): Store=b0c7e502cc37c83c904b4a8353af2747/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened de4dd0cd409fe4d62ad5aeb9c63d3465; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65444007, jitterRate=-0.024808302521705627}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for de4dd0cd409fe4d62ad5aeb9c63d3465: Running coprocessor pre-open hook at 1675782202650Writing region info on filesystem at 1675782202650Initializing all the Stores at 1675782202650Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202650Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202656 (+6 ms)Cleaning up temporary data from old regions at 1675782202662 (+6 ms)Cleaning up detritus from prior splits at 1675782202662Running coprocessor post-open hooks at 1675782202667 (+5 ms)Region opened successfully at 1675782202667 2023-02-07 15:03:22,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465., pid=29, masterSystemTime=1675782202611 2023-02-07 15:03:22,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:22,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:22,669 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=de4dd0cd409fe4d62ad5aeb9c63d3465, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,669 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202669"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202669"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202669"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202669"}]},"ts":"1675782202669"} 2023-02-07 15:03:22,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:22,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6abc99196eeaac57d24e398f1a94e304, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 15:03:22,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:22,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,672 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-07 15:03:22,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure de4dd0cd409fe4d62ad5aeb9c63d3465, server=jenkins-hbase4.apache.org,34587,1675782200572 in 210 msec 2023-02-07 15:03:22,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b0c7e502cc37c83c904b4a8353af2747; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65689683, jitterRate=-0.02114744484424591}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b0c7e502cc37c83c904b4a8353af2747: Running coprocessor pre-open hook at 1675782202660Writing region info on filesystem at 1675782202660Initializing all the Stores at 1675782202661 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202661Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202661Cleaning up temporary data from old regions at 1675782202668 (+7 ms)Cleaning up detritus from prior splits at 1675782202668Running coprocessor post-open hooks at 1675782202673 (+5 ms)Region opened successfully at 1675782202673 2023-02-07 15:03:22,673 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1 2023-02-07 15:03:22,674 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1 2023-02-07 15:03:22,674 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6abc99196eeaac57d24e398f1a94e304 columnFamilyName f1 2023-02-07 15:03:22,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de4dd0cd409fe4d62ad5aeb9c63d3465, ASSIGN in 382 msec 2023-02-07 15:03:22,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747., pid=22, masterSystemTime=1675782202605 2023-02-07 15:03:22,674 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(310): Store=6abc99196eeaac57d24e398f1a94e304/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,674 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:22,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:22,676 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2 2023-02-07 15:03:22,676 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2 2023-02-07 15:03:22,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:22,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b0c7e502cc37c83c904b4a8353af2747, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 74192f33ac005cdd568f16ce85f8d2c2, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 15:03:22,676 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6abc99196eeaac57d24e398f1a94e304 columnFamilyName f2 2023-02-07 15:03:22,676 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202676"}]},"ts":"1675782202676"} 2023-02-07 15:03:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,677 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(310): Store=6abc99196eeaac57d24e398f1a94e304/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,678 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-07 15:03:22,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure b0c7e502cc37c83c904b4a8353af2747, server=jenkins-hbase4.apache.org,40501,1675782200546 in 225 msec 2023-02-07 15:03:22,680 DEBUG [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f1 2023-02-07 15:03:22,680 DEBUG [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f1 2023-02-07 15:03:22,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,680 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74192f33ac005cdd568f16ce85f8d2c2 columnFamilyName f1 2023-02-07 15:03:22,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0c7e502cc37c83c904b4a8353af2747, ASSIGN in 388 msec 2023-02-07 15:03:22,681 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(310): Store=74192f33ac005cdd568f16ce85f8d2c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,681 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:22,682 DEBUG [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f2 2023-02-07 15:03:22,682 DEBUG [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f2 2023-02-07 15:03:22,682 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74192f33ac005cdd568f16ce85f8d2c2 columnFamilyName f2 2023-02-07 15:03:22,683 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(310): Store=74192f33ac005cdd568f16ce85f8d2c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6abc99196eeaac57d24e398f1a94e304; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61527512, jitterRate=-0.083168625831604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6abc99196eeaac57d24e398f1a94e304: Running coprocessor pre-open hook at 1675782202670Writing region info on filesystem at 1675782202670Initializing all the Stores at 1675782202671 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202671Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202671Cleaning up temporary data from old regions at 1675782202679 (+8 ms)Cleaning up detritus from prior splits at 1675782202679Running coprocessor post-open hooks at 1675782202684 (+5 ms)Region opened successfully at 1675782202684 2023-02-07 15:03:22,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304., pid=30, masterSystemTime=1675782202611 2023-02-07 15:03:22,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:22,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:22,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:22,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c2e037e417bc7fcf13f24e7af86bbce, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 15:03:22,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,686 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6abc99196eeaac57d24e398f1a94e304, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:22,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,686 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202686"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202686"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202686"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202686"}]},"ts":"1675782202686"} 2023-02-07 15:03:22,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:22,688 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,689 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1 2023-02-07 15:03:22,689 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1 2023-02-07 15:03:22,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-07 15:03:22,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 6abc99196eeaac57d24e398f1a94e304, server=jenkins-hbase4.apache.org,34587,1675782200572 in 226 msec 2023-02-07 15:03:22,690 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c2e037e417bc7fcf13f24e7af86bbce columnFamilyName f1 2023-02-07 15:03:22,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 74192f33ac005cdd568f16ce85f8d2c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60426442, jitterRate=-0.09957584738731384}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 74192f33ac005cdd568f16ce85f8d2c2: Running coprocessor pre-open hook at 1675782202677Writing region info on filesystem at 1675782202677Initializing all the Stores at 1675782202678 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202678Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202678Cleaning up temporary data from old regions at 1675782202684 (+6 ms)Cleaning up detritus from prior splits at 1675782202685 (+1 ms)Running coprocessor post-open hooks at 1675782202690 (+5 ms)Region opened successfully at 1675782202690 2023-02-07 15:03:22,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6abc99196eeaac57d24e398f1a94e304, ASSIGN in 399 msec 2023-02-07 15:03:22,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2., pid=25, masterSystemTime=1675782202605 2023-02-07 15:03:22,692 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(310): Store=9c2e037e417bc7fcf13f24e7af86bbce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,692 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:22,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:22,693 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=74192f33ac005cdd568f16ce85f8d2c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:22,693 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782202693"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202693"}]},"ts":"1675782202693"} 2023-02-07 15:03:22,693 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2 2023-02-07 15:03:22,693 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2 2023-02-07 15:03:22,694 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c2e037e417bc7fcf13f24e7af86bbce columnFamilyName f2 2023-02-07 15:03:22,695 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(310): Store=9c2e037e417bc7fcf13f24e7af86bbce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:22,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-07 15:03:22,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 74192f33ac005cdd568f16ce85f8d2c2, server=jenkins-hbase4.apache.org,40501,1675782200546 in 239 msec 2023-02-07 15:03:22,698 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=74192f33ac005cdd568f16ce85f8d2c2, ASSIGN in 406 msec 2023-02-07 15:03:22,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:22,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:22,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:22,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9c2e037e417bc7fcf13f24e7af86bbce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72100943, jitterRate=0.07438777387142181}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:22,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9c2e037e417bc7fcf13f24e7af86bbce: Running coprocessor pre-open hook at 1675782202686Writing region info on filesystem at 1675782202686Initializing all the Stores at 1675782202687 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202687Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782202687Cleaning up temporary data from old regions at 1675782202697 (+10 ms)Cleaning up detritus from prior splits at 1675782202697Running coprocessor post-open hooks at 1675782202702 (+5 ms)Region opened successfully at 1675782202702 2023-02-07 15:03:22,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce., pid=28, masterSystemTime=1675782202611 2023-02-07 15:03:22,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:22,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:22,704 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9c2e037e417bc7fcf13f24e7af86bbce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:22,704 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782202704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782202704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782202704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782202704"}]},"ts":"1675782202704"} 2023-02-07 15:03:22,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-07 15:03:22,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 9c2e037e417bc7fcf13f24e7af86bbce, server=jenkins-hbase4.apache.org,34587,1675782200572 in 246 msec 2023-02-07 15:03:22,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-02-07 15:03:22,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9c2e037e417bc7fcf13f24e7af86bbce, ASSIGN in 416 msec 2023-02-07 15:03:22,709 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:22,710 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782202709"}]},"ts":"1675782202709"} 2023-02-07 15:03:22,711 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-07 15:03:22,713 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:22,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 886 msec 2023-02-07 15:03:22,938 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:22,938 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:22,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:22,940 INFO [Listener at localhost/42617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-07 15:03:22,940 DEBUG [Listener at localhost/42617] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-07 15:03:22,940 INFO [Listener at localhost/42617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:22,947 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-07 15:03:22,947 INFO [Listener at localhost/42617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:22,947 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-07 15:03:22,947 INFO [Listener at localhost/42617] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 15:03:22,978 DEBUG [hconnection-0x25711d63-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:22,989 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55078, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:22,994 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40501] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:22,995 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:23,058 INFO [Listener at localhost/42617] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 15:03:23,058 INFO [Listener at localhost/42617] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 15:03:23,058 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:23,058 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:23,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 15:03:23,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675782203060 (current time:1675782203060). 2023-02-07 15:03:23,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 15:03:23,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] zookeeper.ReadOnlyZKClient(139): Connect 0x24356d9c to 127.0.0.1:50579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:23,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33856f42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:23,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:23,070 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44208, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:23,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24356d9c to 127.0.0.1:50579 2023-02-07 15:03:23,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:23,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 15:03:23,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 15:03:23,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 15:03:23,075 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 15:03:23,075 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675782803075 2023-02-07 15:03:23,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 15:03:23,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,077 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:23,077 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 15:03:23,077 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 15:03:23,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 15:03:23,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-07 15:03:23,079 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 15:03:23,079 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675782803079 2023-02-07 15:03:23,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,092 INFO [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-07 15:03:23,092 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:23,093 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-07 15:03:23,093 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 15:03:23,093 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,093 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,094 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,094 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:23,094 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:23,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:23,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:23,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:23,095 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,095 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,095 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,095 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-07 15:03:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-07 15:03:23,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-07 15:03:23,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,100 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-07 15:03:23,100 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:23,100 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-07 15:03:23,100 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:23,102 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 15:03:23,102 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 15:03:23,102 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 15:03:23,102 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 15:03:23,102 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34587,1675782200572' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 15:03:23,102 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40501,1675782200546' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 15:03:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,104 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,104 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34587,1675782200572' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31ba115a[Count = 1] remaining members to acquire global barrier 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:23,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40501,1675782200546' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 15:03:23,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31ba115a[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:23,107 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 15:03:23,107 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,109 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,109 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,109 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 15:03:23,109 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,109 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 15:03:23,110 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,110 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:23,112 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:23,112 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. started... 2023-02-07 15:03:23,112 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:23,112 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. started... 2023-02-07 15:03:23,112 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:23,112 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. started... 2023-02-07 15:03:23,115 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f5a441015f7aec14f7fc86d53bcdd714 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:23,115 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:23,115 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 15:03:23,115 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. started... 2023-02-07 15:03:23,115 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:23,115 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 15:03:23,116 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:23,115 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.HRegion(2744): Flushing de4dd0cd409fe4d62ad5aeb9c63d3465 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:23,115 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 124c6c7d3f7a07c87266dcbcd5922857 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 15:03:23,116 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9c2e037e417bc7fcf13f24e7af86bbce 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:23,116 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. started... 2023-02-07 15:03:23,115 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:23,115 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:23,117 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 74192f33ac005cdd568f16ce85f8d2c2: 2023-02-07 15:03:23,117 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,117 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. started... 2023-02-07 15:03:23,118 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,118 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6abc99196eeaac57d24e398f1a94e304 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:23,118 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:23,118 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:23,152 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f1/5d1a646a909948d898999fedac177920 2023-02-07 15:03:23,152 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f1/3fb8b296a1fc45ecb96cbda51d12014c 2023-02-07 15:03:23,153 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f1/c084986af60c481bb468f57cc61e4be6 2023-02-07 15:03:23,155 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. completed. 2023-02-07 15:03:23,155 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:23,155 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:23,155 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. started... 2023-02-07 15:03:23,156 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b0c7e502cc37c83c904b4a8353af2747 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:23,156 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 15:03:23,157 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f1/fb3b51238bd64100a2620bbcb2d10d7b 2023-02-07 15:03:23,160 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f1/a43cd88ed4334d9c97b03f5e87b4ddec 2023-02-07 15:03:23,178 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:23,179 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:23,179 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:23,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 15:03:23,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:23,180 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 15:03:23,205 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f1/9bfde7cdcdc14424ae49c78c3d9d368c 2023-02-07 15:03:23,206 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f2/de1be1a2fc6f4237b442c3a84d928e8b 2023-02-07 15:03:23,206 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f2/b834a4eb23794b7bb1af3514ede02ed9 2023-02-07 15:03:23,208 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f2/3c7014a45be240bcbbd7ee03accd9690 2023-02-07 15:03:23,213 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f2/f7fad8889ebb450ba221d762b37fbe9d 2023-02-07 15:03:23,215 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f2/106ec9d4b55542238028282ac84f48bc 2023-02-07 15:03:23,219 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f1/a43cd88ed4334d9c97b03f5e87b4ddec as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/a43cd88ed4334d9c97b03f5e87b4ddec 2023-02-07 15:03:23,219 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f1/c084986af60c481bb468f57cc61e4be6 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/c084986af60c481bb468f57cc61e4be6 2023-02-07 15:03:23,222 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f1/3fb8b296a1fc45ecb96cbda51d12014c as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/3fb8b296a1fc45ecb96cbda51d12014c 2023-02-07 15:03:23,222 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f1/fb3b51238bd64100a2620bbcb2d10d7b as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/fb3b51238bd64100a2620bbcb2d10d7b 2023-02-07 15:03:23,226 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f1/5d1a646a909948d898999fedac177920 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/5d1a646a909948d898999fedac177920 2023-02-07 15:03:23,227 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/c084986af60c481bb468f57cc61e4be6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,227 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/3fb8b296a1fc45ecb96cbda51d12014c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:23,227 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/a43cd88ed4334d9c97b03f5e87b4ddec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,228 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f2/3c7014a45be240bcbbd7ee03accd9690 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/3c7014a45be240bcbbd7ee03accd9690 2023-02-07 15:03:23,228 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f2/de1be1a2fc6f4237b442c3a84d928e8b as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/de1be1a2fc6f4237b442c3a84d928e8b 2023-02-07 15:03:23,228 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f2/b834a4eb23794b7bb1af3514ede02ed9 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/b834a4eb23794b7bb1af3514ede02ed9 2023-02-07 15:03:23,228 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/fb3b51238bd64100a2620bbcb2d10d7b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,229 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f2/f7fad8889ebb450ba221d762b37fbe9d as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/f7fad8889ebb450ba221d762b37fbe9d 2023-02-07 15:03:23,234 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/de1be1a2fc6f4237b442c3a84d928e8b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:23,234 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/b834a4eb23794b7bb1af3514ede02ed9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,234 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 124c6c7d3f7a07c87266dcbcd5922857 in 119ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,235 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-07 15:03:23,235 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9c2e037e417bc7fcf13f24e7af86bbce in 119ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,235 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-07 15:03:23,235 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 124c6c7d3f7a07c87266dcbcd5922857: 2023-02-07 15:03:23,236 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9c2e037e417bc7fcf13f24e7af86bbce: 2023-02-07 15:03:23,236 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,236 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,236 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/3fb8b296a1fc45ecb96cbda51d12014c] hfiles 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/3fb8b296a1fc45ecb96cbda51d12014c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/de1be1a2fc6f4237b442c3a84d928e8b] hfiles 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/de1be1a2fc6f4237b442c3a84d928e8b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/a43cd88ed4334d9c97b03f5e87b4ddec] hfiles 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/a43cd88ed4334d9c97b03f5e87b4ddec for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/b834a4eb23794b7bb1af3514ede02ed9] hfiles 2023-02-07 15:03:23,238 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/b834a4eb23794b7bb1af3514ede02ed9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,240 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/5d1a646a909948d898999fedac177920, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,240 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/3c7014a45be240bcbbd7ee03accd9690, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,241 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/f7fad8889ebb450ba221d762b37fbe9d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,243 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f2/106ec9d4b55542238028282ac84f48bc as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/106ec9d4b55542238028282ac84f48bc 2023-02-07 15:03:23,244 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6abc99196eeaac57d24e398f1a94e304 in 126ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6abc99196eeaac57d24e398f1a94e304: 2023-02-07 15:03:23,244 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f5a441015f7aec14f7fc86d53bcdd714 in 129ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f5a441015f7aec14f7fc86d53bcdd714: 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/c084986af60c481bb468f57cc61e4be6] hfiles 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/c084986af60c481bb468f57cc61e4be6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/3c7014a45be240bcbbd7ee03accd9690] hfiles 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/3c7014a45be240bcbbd7ee03accd9690 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/fb3b51238bd64100a2620bbcb2d10d7b] hfiles 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/fb3b51238bd64100a2620bbcb2d10d7b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/f7fad8889ebb450ba221d762b37fbe9d] hfiles 2023-02-07 15:03:23,244 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/f7fad8889ebb450ba221d762b37fbe9d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,245 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f2/521cbd966c3b4629abfddbaf530dd10f 2023-02-07 15:03:23,254 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f1/9bfde7cdcdc14424ae49c78c3d9d368c as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9bfde7cdcdc14424ae49c78c3d9d368c 2023-02-07 15:03:23,262 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/106ec9d4b55542238028282ac84f48bc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,262 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9bfde7cdcdc14424ae49c78c3d9d368c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,263 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f2/521cbd966c3b4629abfddbaf530dd10f as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/521cbd966c3b4629abfddbaf530dd10f 2023-02-07 15:03:23,263 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for de4dd0cd409fe4d62ad5aeb9c63d3465 in 148ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,263 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for de4dd0cd409fe4d62ad5aeb9c63d3465: 2023-02-07 15:03:23,263 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,263 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,263 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/5d1a646a909948d898999fedac177920] hfiles 2023-02-07 15:03:23,263 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/5d1a646a909948d898999fedac177920 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,263 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/106ec9d4b55542238028282ac84f48bc] hfiles 2023-02-07 15:03:23,264 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/106ec9d4b55542238028282ac84f48bc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,276 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. completed. 2023-02-07 15:03:23,276 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:23,276 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 15:03:23,276 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. started... 2023-02-07 15:03:23,278 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ef20cfe0da07f5897e599c734db8eb58 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 15:03:23,280 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. completed. 2023-02-07 15:03:23,280 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:23,280 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:23,280 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 15:03:23,280 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. started... 2023-02-07 15:03:23,280 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. completed. 2023-02-07 15:03:23,280 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:23,281 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 15:03:23,282 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 22bba9af64d7162ee33e53974dde6f1e: 2023-02-07 15:03:23,282 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,282 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,282 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:23,282 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 15:03:23,282 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/521cbd966c3b4629abfddbaf530dd10f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,283 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b0c7e502cc37c83c904b4a8353af2747 in 127ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,283 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b0c7e502cc37c83c904b4a8353af2747: 2023-02-07 15:03:23,283 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,283 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,283 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9bfde7cdcdc14424ae49c78c3d9d368c] hfiles 2023-02-07 15:03:23,283 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9bfde7cdcdc14424ae49c78c3d9d368c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,284 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/521cbd966c3b4629abfddbaf530dd10f] hfiles 2023-02-07 15:03:23,284 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/521cbd966c3b4629abfddbaf530dd10f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,284 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. completed. 2023-02-07 15:03:23,284 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:23,284 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:23,284 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 15:03:23,284 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. started... 2023-02-07 15:03:23,289 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7cc3bd9568047197cbcc41737dccbcef 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 15:03:23,298 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. completed. 2023-02-07 15:03:23,298 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:23,299 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 15:03:23,304 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f1/cbf1a45f037a497a82161428012041a2 2023-02-07 15:03:23,305 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. completed. 2023-02-07 15:03:23,305 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:23,305 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 15:03:23,308 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f1/92ad557b2e414a398851ce280b829ec5 2023-02-07 15:03:23,324 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f2/67d805385335428b95a4d61f1142c63f 2023-02-07 15:03:23,326 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f2/2e8a3f0bc8394b2f996714bf73aca591 2023-02-07 15:03:23,329 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f1/cbf1a45f037a497a82161428012041a2 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/cbf1a45f037a497a82161428012041a2 2023-02-07 15:03:23,330 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f1/92ad557b2e414a398851ce280b829ec5 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/92ad557b2e414a398851ce280b829ec5 2023-02-07 15:03:23,337 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/cbf1a45f037a497a82161428012041a2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,338 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f2/67d805385335428b95a4d61f1142c63f as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/67d805385335428b95a4d61f1142c63f 2023-02-07 15:03:23,339 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/92ad557b2e414a398851ce280b829ec5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:23,340 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f2/2e8a3f0bc8394b2f996714bf73aca591 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/2e8a3f0bc8394b2f996714bf73aca591 2023-02-07 15:03:23,342 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/67d805385335428b95a4d61f1142c63f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 15:03:23,343 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ef20cfe0da07f5897e599c734db8eb58 in 65ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,343 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ef20cfe0da07f5897e599c734db8eb58: 2023-02-07 15:03:23,343 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,344 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,344 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/cbf1a45f037a497a82161428012041a2] hfiles 2023-02-07 15:03:23,344 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/2e8a3f0bc8394b2f996714bf73aca591, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 15:03:23,344 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/cbf1a45f037a497a82161428012041a2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,344 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/67d805385335428b95a4d61f1142c63f] hfiles 2023-02-07 15:03:23,344 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/67d805385335428b95a4d61f1142c63f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,344 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7cc3bd9568047197cbcc41737dccbcef in 55ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:23,345 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7cc3bd9568047197cbcc41737dccbcef: 2023-02-07 15:03:23,345 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,345 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:23,345 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/92ad557b2e414a398851ce280b829ec5] hfiles 2023-02-07 15:03:23,345 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/92ad557b2e414a398851ce280b829ec5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,345 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/2e8a3f0bc8394b2f996714bf73aca591] hfiles 2023-02-07 15:03:23,345 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/2e8a3f0bc8394b2f996714bf73aca591 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,355 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. completed. 2023-02-07 15:03:23,355 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:23,355 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 15:03:23,355 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 15:03:23,355 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,355 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 15:03:23,355 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40501,1675782200546' in zk 2023-02-07 15:03:23,357 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. completed. 2023-02-07 15:03:23,357 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:23,357 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,357 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 15:03:23,357 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 15:03:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:23,357 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:23,357 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 15:03:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40501,1675782200546': 2023-02-07 15:03:23,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40501,1675782200546' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 15:03:23,381 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:23,381 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:23,381 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:23,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 15:03:23,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:23,382 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 15:03:23,682 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:23,683 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:23,683 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:23,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 15:03:23,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:23,684 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 15:03:23,690 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. completed. 2023-02-07 15:03:23,690 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:23,690 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 15:03:23,690 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 15:03:23,690 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,690 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 15:03:23,690 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34587,1675782200572' in zk 2023-02-07 15:03:23,691 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,691 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 15:03:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:23,691 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 15:03:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34587,1675782200572': 2023-02-07 15:03:23,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34587,1675782200572' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 15:03:23,694 INFO [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-07 15:03:23,694 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:23,695 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:23,695 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,695 INFO [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 15:03:23,696 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,696 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,696 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:23,696 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:23,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,696 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:23,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,697 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:23,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:23,697 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,699 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:23,699 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:23,705 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,705 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,705 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:23,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:23,706 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:23,706 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,706 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:23,706 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,706 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:23,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:23,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-07 15:03:23,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,759 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:23,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675782203076Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675782203706 (+630 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675782203706Writing data manifest for testWithMockedMapReduceMultiRegion at 1675782203717 (+11 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675782203724 (+7 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675782203759 (+35 ms) 2023-02-07 15:03:23,761 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 15:03:23,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 684 msec 2023-02-07 15:03:24,184 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:24,185 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:24,185 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:24,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 15:03:24,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 15:03:24,186 INFO [Listener at localhost/42617] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 15:03:24,186 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:24,186 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:24,191 INFO [Listener at localhost/42617] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 15:03:24,196 INFO [Listener at localhost/42617] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 15:03:24,218 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40501] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:24,219 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:24,294 INFO [Listener at localhost/42617] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 15:03:24,298 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:24,298 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:24,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 15:03:24,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,304 INFO [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-07 15:03:24,304 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:24,305 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-07 15:03:24,305 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 15:03:24,305 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,305 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,306 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:24,306 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:24,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:24,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:24,306 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:24,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:24,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,307 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,307 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,307 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,308 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,309 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-07 15:03:24,309 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:24,309 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-07 15:03:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 15:03:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 15:03:24,313 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:24,313 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. started... 2023-02-07 15:03:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 15:03:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:24,313 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:24,314 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de4dd0cd409fe4d62ad5aeb9c63d3465 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:24,314 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:24,314 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. started... 2023-02-07 15:03:24,314 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. started... 2023-02-07 15:03:24,314 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9c2e037e417bc7fcf13f24e7af86bbce 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:24,314 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6abc99196eeaac57d24e398f1a94e304 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:24,318 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:24,318 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:24,318 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. started... 2023-02-07 15:03:24,319 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:24,319 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. started... 2023-02-07 15:03:24,319 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 15:03:24,319 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:24,319 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f5a441015f7aec14f7fc86d53bcdd714 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:24,319 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. started... 2023-02-07 15:03:24,319 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 124c6c7d3f7a07c87266dcbcd5922857 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 15:03:24,320 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 74192f33ac005cdd568f16ce85f8d2c2: 2023-02-07 15:03:24,320 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:24,320 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:24,320 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. started... 2023-02-07 15:03:24,320 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 15:03:24,320 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b0c7e502cc37c83c904b4a8353af2747 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:24,340 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f1/9de948c379ea40b4aa89b25001109c59 2023-02-07 15:03:24,348 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f1/2a80455e63e6465794a879b10b55bad2 2023-02-07 15:03:24,352 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f1/a8965d06703145d7b12bbaebccddf05c 2023-02-07 15:03:24,352 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f1/d3fb8c6c7e4b4c6a9f7f65afa70f83cb 2023-02-07 15:03:24,384 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f1/9d171a29cbe84b4bb021033aeb322dec 2023-02-07 15:03:24,384 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f1/526d8b17d5ce4c8382cfe88fa4891986 2023-02-07 15:03:24,401 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f2/52e588ecba4243ebb43cc4680bf5111c 2023-02-07 15:03:24,408 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f1/9de948c379ea40b4aa89b25001109c59 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/9de948c379ea40b4aa89b25001109c59 2023-02-07 15:03:24,412 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/9de948c379ea40b4aa89b25001109c59, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,412 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/.tmp/f2/52e588ecba4243ebb43cc4680bf5111c as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/52e588ecba4243ebb43cc4680bf5111c 2023-02-07 15:03:24,417 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/52e588ecba4243ebb43cc4680bf5111c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,417 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for de4dd0cd409fe4d62ad5aeb9c63d3465 in 103ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de4dd0cd409fe4d62ad5aeb9c63d3465: 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. started... 2023-02-07 15:03:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22bba9af64d7162ee33e53974dde6f1e: 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 15:03:24,418 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f2/f32ab4ccef504fa3b8903e3f5c417f47 2023-02-07 15:03:24,418 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. started... 2023-02-07 15:03:24,418 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7cc3bd9568047197cbcc41737dccbcef 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 15:03:24,424 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f1/d3fb8c6c7e4b4c6a9f7f65afa70f83cb as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/d3fb8c6c7e4b4c6a9f7f65afa70f83cb 2023-02-07 15:03:24,428 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/d3fb8c6c7e4b4c6a9f7f65afa70f83cb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,428 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f2/11c4e40fadf4468180c04b46bc8c4986 2023-02-07 15:03:24,428 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f2/b173c99bb6f94e86b2db8a9bd66b8023 2023-02-07 15:03:24,435 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/.tmp/f2/f32ab4ccef504fa3b8903e3f5c417f47 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/f32ab4ccef504fa3b8903e3f5c417f47 2023-02-07 15:03:24,442 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f2/7758ddbf497e4fe49e020f3cc6e47ea0 2023-02-07 15:03:24,442 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f2/4fcaba6867574de0949fccd6ef4100ab 2023-02-07 15:03:24,443 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f1/2a80455e63e6465794a879b10b55bad2 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/2a80455e63e6465794a879b10b55bad2 2023-02-07 15:03:24,444 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f1/a8965d06703145d7b12bbaebccddf05c as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/a8965d06703145d7b12bbaebccddf05c 2023-02-07 15:03:24,445 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/f32ab4ccef504fa3b8903e3f5c417f47, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,447 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9c2e037e417bc7fcf13f24e7af86bbce in 133ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,447 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9c2e037e417bc7fcf13f24e7af86bbce: 2023-02-07 15:03:24,447 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 15:03:24,448 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f1/bc2ce9022082497cb2a078761d15024a 2023-02-07 15:03:24,450 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/2a80455e63e6465794a879b10b55bad2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,450 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f1/526d8b17d5ce4c8382cfe88fa4891986 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/526d8b17d5ce4c8382cfe88fa4891986 2023-02-07 15:03:24,450 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f1/9d171a29cbe84b4bb021033aeb322dec as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9d171a29cbe84b4bb021033aeb322dec 2023-02-07 15:03:24,450 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/.tmp/f2/11c4e40fadf4468180c04b46bc8c4986 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/11c4e40fadf4468180c04b46bc8c4986 2023-02-07 15:03:24,450 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/a8965d06703145d7b12bbaebccddf05c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:24,451 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/.tmp/f2/b173c99bb6f94e86b2db8a9bd66b8023 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/b173c99bb6f94e86b2db8a9bd66b8023 2023-02-07 15:03:24,455 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/526d8b17d5ce4c8382cfe88fa4891986, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,456 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9d171a29cbe84b4bb021033aeb322dec, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,456 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/.tmp/f2/4fcaba6867574de0949fccd6ef4100ab as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/4fcaba6867574de0949fccd6ef4100ab 2023-02-07 15:03:24,457 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/.tmp/f2/7758ddbf497e4fe49e020f3cc6e47ea0 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/7758ddbf497e4fe49e020f3cc6e47ea0 2023-02-07 15:03:24,457 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/11c4e40fadf4468180c04b46bc8c4986, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,458 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6abc99196eeaac57d24e398f1a94e304 in 144ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,458 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6abc99196eeaac57d24e398f1a94e304: 2023-02-07 15:03:24,458 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:24,458 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 15:03:24,459 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/b173c99bb6f94e86b2db8a9bd66b8023, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:24,460 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 124c6c7d3f7a07c87266dcbcd5922857 in 141ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,460 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 124c6c7d3f7a07c87266dcbcd5922857: 2023-02-07 15:03:24,460 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:24,460 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 15:03:24,460 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. started... 2023-02-07 15:03:24,460 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ef20cfe0da07f5897e599c734db8eb58 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 15:03:24,466 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/7758ddbf497e4fe49e020f3cc6e47ea0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,466 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b0c7e502cc37c83c904b4a8353af2747 in 146ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,466 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b0c7e502cc37c83c904b4a8353af2747: 2023-02-07 15:03:24,466 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:24,466 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 15:03:24,472 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f2/94c0cce133ef463c854237f40e9aace1 2023-02-07 15:03:24,473 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/4fcaba6867574de0949fccd6ef4100ab, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,474 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f5a441015f7aec14f7fc86d53bcdd714 in 155ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,474 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f5a441015f7aec14f7fc86d53bcdd714: 2023-02-07 15:03:24,474 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 15:03:24,476 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f1/911baa3e037645c6be8f2594d2ab1358 2023-02-07 15:03:24,478 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f1/bc2ce9022082497cb2a078761d15024a as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/bc2ce9022082497cb2a078761d15024a 2023-02-07 15:03:24,482 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/bc2ce9022082497cb2a078761d15024a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:24,485 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/.tmp/f2/94c0cce133ef463c854237f40e9aace1 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/94c0cce133ef463c854237f40e9aace1 2023-02-07 15:03:24,493 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/94c0cce133ef463c854237f40e9aace1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 15:03:24,494 INFO [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7cc3bd9568047197cbcc41737dccbcef in 76ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,494 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7cc3bd9568047197cbcc41737dccbcef: 2023-02-07 15:03:24,494 DEBUG [rs(jenkins-hbase4.apache.org,34587,1675782200572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:24,494 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 15:03:24,494 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 15:03:24,494 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,496 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 15:03:24,496 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34587,1675782200572' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 15:03:24,498 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,498 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:24,498 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,498 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:24,499 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f2/335e3e9c44244ad4b34f80e13bb37b35 2023-02-07 15:03:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:24,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34587,1675782200572' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 15:03:24,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@358583b5[Count = 1] remaining members to acquire global barrier 2023-02-07 15:03:24,503 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f1/911baa3e037645c6be8f2594d2ab1358 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/911baa3e037645c6be8f2594d2ab1358 2023-02-07 15:03:24,508 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/911baa3e037645c6be8f2594d2ab1358, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,508 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/.tmp/f2/335e3e9c44244ad4b34f80e13bb37b35 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/335e3e9c44244ad4b34f80e13bb37b35 2023-02-07 15:03:24,512 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/335e3e9c44244ad4b34f80e13bb37b35, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 15:03:24,513 INFO [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ef20cfe0da07f5897e599c734db8eb58 in 53ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:24,513 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ef20cfe0da07f5897e599c734db8eb58: 2023-02-07 15:03:24,513 DEBUG [rs(jenkins-hbase4.apache.org,40501,1675782200546)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:24,513 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 15:03:24,513 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 15:03:24,513 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,513 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 15:03:24,513 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40501,1675782200546' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 15:03:24,517 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,517 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:24,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:24,517 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,517 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:24,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:24,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:24,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:24,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40501,1675782200546' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 15:03:24,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@358583b5[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:24,519 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 15:03:24,519 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,520 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,520 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,520 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 15:03:24,520 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 15:03:24,520 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 15:03:24,520 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,520 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 15:03:24,520 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40501,1675782200546' in zk 2023-02-07 15:03:24,520 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34587,1675782200572' in zk 2023-02-07 15:03:24,521 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,521 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:24,522 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,522 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 15:03:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:24,522 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,522 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 15:03:24,522 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:24,522 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:24,522 DEBUG [member: 'jenkins-hbase4.apache.org,34587,1675782200572' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 15:03:24,522 DEBUG [member: 'jenkins-hbase4.apache.org,40501,1675782200546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 15:03:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34587,1675782200572': 2023-02-07 15:03:24,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34587,1675782200572' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 15:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40501,1675782200546': 2023-02-07 15:03:24,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40501,1675782200546' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 15:03:24,527 INFO [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-07 15:03:24,527 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:24,527 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:24,527 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,527 INFO [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 15:03:24,529 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:24,529 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:24,529 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:24,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:24,530 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,531 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,531 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,539 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:24,539 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:24,539 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:24,539 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:24,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:24,539 DEBUG [(jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:24,539 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-07 15:03:24,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 15:03:24,539 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:24,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,540 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,640 DEBUG [Listener at localhost/42617] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 15:03:24,641 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:24,641 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:24,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 15:03:24,647 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675782203060 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:24,647 DEBUG [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(239): region to add: ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=de4dd0cd409fe4d62ad5aeb9c63d3465 as de4dd0cd409fe4d62ad5aeb9c63d3465 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=9c2e037e417bc7fcf13f24e7af86bbce as 9c2e037e417bc7fcf13f24e7af86bbce in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=6abc99196eeaac57d24e398f1a94e304 as 6abc99196eeaac57d24e398f1a94e304 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=f5a441015f7aec14f7fc86d53bcdd714 as f5a441015f7aec14f7fc86d53bcdd714 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,648 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=124c6c7d3f7a07c87266dcbcd5922857 as 124c6c7d3f7a07c87266dcbcd5922857 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,649 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=74192f33ac005cdd568f16ce85f8d2c2 as 74192f33ac005cdd568f16ce85f8d2c2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,649 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=b0c7e502cc37c83c904b4a8353af2747 as b0c7e502cc37c83c904b4a8353af2747 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,649 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=22bba9af64d7162ee33e53974dde6f1e as 22bba9af64d7162ee33e53974dde6f1e in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,649 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=7cc3bd9568047197cbcc41737dccbcef as 7cc3bd9568047197cbcc41737dccbcef in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,649 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(585): clone region=ef20cfe0da07f5897e599c734db8eb58 as ef20cfe0da07f5897e599c734db8eb58 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,650 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 124c6c7d3f7a07c87266dcbcd5922857, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,650 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 22bba9af64d7162ee33e53974dde6f1e, NAME => 'testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,651 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6abc99196eeaac57d24e398f1a94e304, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,651 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => de4dd0cd409fe4d62ad5aeb9c63d3465, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,651 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 74192f33ac005cdd568f16ce85f8d2c2, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,651 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f5a441015f7aec14f7fc86d53bcdd714, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,651 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9c2e037e417bc7fcf13f24e7af86bbce, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,652 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => b0c7e502cc37c83c904b4a8353af2747, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,691 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,692 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a43cd88ed4334d9c97b03f5e87b4ddec from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,693 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,693 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3fb8b296a1fc45ecb96cbda51d12014c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,693 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,694 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 74192f33ac005cdd568f16ce85f8d2c2, disabling compactions & flushes 2023-02-07 15:03:24,694 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:24,694 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:24,694 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. after waiting 0 ms 2023-02-07 15:03:24,694 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:24,694 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:24,694 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 74192f33ac005cdd568f16ce85f8d2c2: Waiting for close lock at 1675782204694Disabling compacts and flushes for region at 1675782204694Disabling writes for close at 1675782204694Writing region close event to WAL at 1675782204694Closed at 1675782204694 2023-02-07 15:03:24,694 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 7cc3bd9568047197cbcc41737dccbcef, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,694 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,694 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,695 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c084986af60c481bb468f57cc61e4be6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,695 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb3b51238bd64100a2620bbcb2d10d7b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,696 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,696 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9bfde7cdcdc14424ae49c78c3d9d368c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,697 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b834a4eb23794b7bb1af3514ede02ed9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,697 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,697 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d1a646a909948d898999fedac177920 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,697 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,697 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 22bba9af64d7162ee33e53974dde6f1e, disabling compactions & flushes 2023-02-07 15:03:24,697 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:24,697 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:24,698 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. after waiting 0 ms 2023-02-07 15:03:24,698 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:24,698 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:24,698 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 22bba9af64d7162ee33e53974dde6f1e: Waiting for close lock at 1675782204697Disabling compacts and flushes for region at 1675782204697Disabling writes for close at 1675782204698 (+1 ms)Writing region close event to WAL at 1675782204698Closed at 1675782204698 2023-02-07 15:03:24,698 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ef20cfe0da07f5897e599c734db8eb58, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,704 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f7fad8889ebb450ba221d762b37fbe9d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,704 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 521cbd966c3b4629abfddbaf530dd10f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,704 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de1be1a2fc6f4237b442c3a84d928e8b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,705 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 106ec9d4b55542238028282ac84f48bc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 124c6c7d3f7a07c87266dcbcd5922857, disabling compactions & flushes 2023-02-07 15:03:24,707 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:24,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:24,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. after waiting 0 ms 2023-02-07 15:03:24,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:24,707 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:24,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 124c6c7d3f7a07c87266dcbcd5922857: Waiting for close lock at 1675782204707Disabling compacts and flushes for region at 1675782204707Disabling writes for close at 1675782204707Writing region close event to WAL at 1675782204707Closed at 1675782204707 2023-02-07 15:03:24,707 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing de4dd0cd409fe4d62ad5aeb9c63d3465, disabling compactions & flushes 2023-02-07 15:03:24,707 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:24,707 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. after waiting 0 ms 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:24,708 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for de4dd0cd409fe4d62ad5aeb9c63d3465: Waiting for close lock at 1675782204707Disabling compacts and flushes for region at 1675782204707Disabling writes for close at 1675782204708 (+1 ms)Writing region close event to WAL at 1675782204708Closed at 1675782204708 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f5a441015f7aec14f7fc86d53bcdd714, disabling compactions & flushes 2023-02-07 15:03:24,708 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. after waiting 0 ms 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:24,708 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:24,708 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f5a441015f7aec14f7fc86d53bcdd714: Waiting for close lock at 1675782204708Disabling compacts and flushes for region at 1675782204708Disabling writes for close at 1675782204708Writing region close event to WAL at 1675782204708Closed at 1675782204708 2023-02-07 15:03:24,708 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3c7014a45be240bcbbd7ee03accd9690 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing b0c7e502cc37c83c904b4a8353af2747, disabling compactions & flushes 2023-02-07 15:03:24,713 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 9c2e037e417bc7fcf13f24e7af86bbce, disabling compactions & flushes 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:24,713 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. after waiting 0 ms 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:24,713 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for b0c7e502cc37c83c904b4a8353af2747: Waiting for close lock at 1675782204713Disabling compacts and flushes for region at 1675782204713Disabling writes for close at 1675782204713Writing region close event to WAL at 1675782204713Closed at 1675782204713 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. after waiting 0 ms 2023-02-07 15:03:24,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:24,713 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:24,714 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 9c2e037e417bc7fcf13f24e7af86bbce: Waiting for close lock at 1675782204713Disabling compacts and flushes for region at 1675782204713Disabling writes for close at 1675782204713Writing region close event to WAL at 1675782204713Closed at 1675782204713 2023-02-07 15:03:24,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 6abc99196eeaac57d24e398f1a94e304, disabling compactions & flushes 2023-02-07 15:03:24,716 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:24,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:24,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. after waiting 0 ms 2023-02-07 15:03:24,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:24,716 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:24,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 6abc99196eeaac57d24e398f1a94e304: Waiting for close lock at 1675782204716Disabling compacts and flushes for region at 1675782204716Disabling writes for close at 1675782204716Writing region close event to WAL at 1675782204716Closed at 1675782204716 2023-02-07 15:03:24,720 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,720 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 92ad557b2e414a398851ce280b829ec5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,722 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:24,722 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cbf1a45f037a497a82161428012041a2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,722 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2e8a3f0bc8394b2f996714bf73aca591 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,724 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 67d805385335428b95a4d61f1142c63f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:24,724 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 7cc3bd9568047197cbcc41737dccbcef, disabling compactions & flushes 2023-02-07 15:03:24,724 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:24,724 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:24,724 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. after waiting 0 ms 2023-02-07 15:03:24,725 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:24,725 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:24,725 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 7cc3bd9568047197cbcc41737dccbcef: Waiting for close lock at 1675782204724Disabling compacts and flushes for region at 1675782204724Disabling writes for close at 1675782204724Writing region close event to WAL at 1675782204725 (+1 ms)Closed at 1675782204725 2023-02-07 15:03:24,725 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ef20cfe0da07f5897e599c734db8eb58, disabling compactions & flushes 2023-02-07 15:03:24,725 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:24,725 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:24,725 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. after waiting 0 ms 2023-02-07 15:03:24,725 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:24,725 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:24,725 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ef20cfe0da07f5897e599c734db8eb58: Waiting for close lock at 1675782204725Disabling compacts and flushes for region at 1675782204725Disabling writes for close at 1675782204725Writing region close event to WAL at 1675782204725Closed at 1675782204725 2023-02-07 15:03:24,726 INFO [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675782203060 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:24,726 DEBUG [Listener at localhost/42617] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,726 DEBUG [Listener at localhost/42617] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953 2023-02-07 15:03:24,726 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-data/ 2023-02-07 15:03:24,727 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----default/ 2023-02-07 15:03:24,727 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-07 15:03:24,727 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------124c6c7d3f7a07c87266dcbcd5922857/ 2023-02-07 15:03:24,728 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,728 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,728 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=124c6c7d3f7a07c87266dcbcd5922857-3fb8b296a1fc45ecb96cbda51d12014c 2023-02-07 15:03:24,728 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,728 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=124c6c7d3f7a07c87266dcbcd5922857-de1be1a2fc6f4237b442c3a84d928e8b 2023-02-07 15:03:24,729 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------22bba9af64d7162ee33e53974dde6f1e/ 2023-02-07 15:03:24,729 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,729 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------6abc99196eeaac57d24e398f1a94e304/ 2023-02-07 15:03:24,729 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,729 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,729 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6abc99196eeaac57d24e398f1a94e304-c084986af60c481bb468f57cc61e4be6 2023-02-07 15:03:24,730 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,730 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6abc99196eeaac57d24e398f1a94e304-3c7014a45be240bcbbd7ee03accd9690 2023-02-07 15:03:24,730 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------74192f33ac005cdd568f16ce85f8d2c2/ 2023-02-07 15:03:24,730 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,730 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------7cc3bd9568047197cbcc41737dccbcef/ 2023-02-07 15:03:24,730 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,731 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,731 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7cc3bd9568047197cbcc41737dccbcef-92ad557b2e414a398851ce280b829ec5 2023-02-07 15:03:24,731 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,731 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7cc3bd9568047197cbcc41737dccbcef-2e8a3f0bc8394b2f996714bf73aca591 2023-02-07 15:03:24,731 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------9c2e037e417bc7fcf13f24e7af86bbce/ 2023-02-07 15:03:24,731 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,732 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,732 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9c2e037e417bc7fcf13f24e7af86bbce-a43cd88ed4334d9c97b03f5e87b4ddec 2023-02-07 15:03:24,732 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,732 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9c2e037e417bc7fcf13f24e7af86bbce-b834a4eb23794b7bb1af3514ede02ed9 2023-02-07 15:03:24,733 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------b0c7e502cc37c83c904b4a8353af2747/ 2023-02-07 15:03:24,733 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,733 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,733 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b0c7e502cc37c83c904b4a8353af2747-9bfde7cdcdc14424ae49c78c3d9d368c 2023-02-07 15:03:24,733 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,734 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b0c7e502cc37c83c904b4a8353af2747-521cbd966c3b4629abfddbaf530dd10f 2023-02-07 15:03:24,734 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------de4dd0cd409fe4d62ad5aeb9c63d3465/ 2023-02-07 15:03:24,734 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,734 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,735 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=de4dd0cd409fe4d62ad5aeb9c63d3465-5d1a646a909948d898999fedac177920 2023-02-07 15:03:24,735 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,735 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=de4dd0cd409fe4d62ad5aeb9c63d3465-106ec9d4b55542238028282ac84f48bc 2023-02-07 15:03:24,735 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------ef20cfe0da07f5897e599c734db8eb58/ 2023-02-07 15:03:24,735 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,736 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,736 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef20cfe0da07f5897e599c734db8eb58-cbf1a45f037a497a82161428012041a2 2023-02-07 15:03:24,736 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,736 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef20cfe0da07f5897e599c734db8eb58-67d805385335428b95a4d61f1142c63f 2023-02-07 15:03:24,736 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |----------f5a441015f7aec14f7fc86d53bcdd714/ 2023-02-07 15:03:24,737 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:24,737 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:24,737 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f5a441015f7aec14f7fc86d53bcdd714-fb3b51238bd64100a2620bbcb2d10d7b 2023-02-07 15:03:24,737 DEBUG [Listener at localhost/42617] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:24,737 DEBUG [Listener at localhost/42617] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f5a441015f7aec14f7fc86d53bcdd714-f7fad8889ebb450ba221d762b37fbe9d 2023-02-07 15:03:24,740 INFO [Listener at localhost/42617] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 15:03:25,301 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,302 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,303 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,305 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:25,306 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1 2023-02-07 15:03:25,306 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c2e037e417bc7fcf13f24e7af86bbce columnFamilyName f1 2023-02-07 15:03:25,310 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/testWithMockedMapReduceMultiRegion=9c2e037e417bc7fcf13f24e7af86bbce-a43cd88ed4334d9c97b03f5e87b4ddec 2023-02-07 15:03:25,310 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(310): Store=9c2e037e417bc7fcf13f24e7af86bbce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,311 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:25,311 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2 2023-02-07 15:03:25,312 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c2e037e417bc7fcf13f24e7af86bbce columnFamilyName f2 2023-02-07 15:03:25,315 DEBUG [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/testWithMockedMapReduceMultiRegion=9c2e037e417bc7fcf13f24e7af86bbce-b834a4eb23794b7bb1af3514ede02ed9 2023-02-07 15:03:25,315 INFO [StoreOpener-9c2e037e417bc7fcf13f24e7af86bbce-1] regionserver.HStore(310): Store=9c2e037e417bc7fcf13f24e7af86bbce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,316 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,316 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened 9c2e037e417bc7fcf13f24e7af86bbce; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60787493, jitterRate=-0.09419576823711395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,316 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for 9c2e037e417bc7fcf13f24e7af86bbce: Writing region info on filesystem at 1675782205303Initializing all the Stores at 1675782205304 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205304Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205304Region opened successfully at 1675782205316 (+12 ms) 2023-02-07 15:03:25,327 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing 9c2e037e417bc7fcf13f24e7af86bbce, disabling compactions & flushes 2023-02-07 15:03:25,327 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,327 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,328 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. after waiting 0 ms 2023-02-07 15:03:25,328 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,329 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,329 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for 9c2e037e417bc7fcf13f24e7af86bbce: Waiting for close lock at 1675782205327Disabling compacts and flushes for region at 1675782205327Disabling writes for close at 1675782205328 (+1 ms)Writing region close event to WAL at 1675782205329 (+1 ms)Closed at 1675782205329 2023-02-07 15:03:25,329 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,330 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,331 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,333 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:25,334 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1 2023-02-07 15:03:25,335 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 124c6c7d3f7a07c87266dcbcd5922857 columnFamilyName f1 2023-02-07 15:03:25,341 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/testWithMockedMapReduceMultiRegion=124c6c7d3f7a07c87266dcbcd5922857-3fb8b296a1fc45ecb96cbda51d12014c 2023-02-07 15:03:25,341 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(310): Store=124c6c7d3f7a07c87266dcbcd5922857/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,342 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:25,342 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2 2023-02-07 15:03:25,343 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 124c6c7d3f7a07c87266dcbcd5922857 columnFamilyName f2 2023-02-07 15:03:25,350 DEBUG [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/testWithMockedMapReduceMultiRegion=124c6c7d3f7a07c87266dcbcd5922857-de1be1a2fc6f4237b442c3a84d928e8b 2023-02-07 15:03:25,350 INFO [StoreOpener-124c6c7d3f7a07c87266dcbcd5922857-1] regionserver.HStore(310): Store=124c6c7d3f7a07c87266dcbcd5922857/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,351 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,351 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened 124c6c7d3f7a07c87266dcbcd5922857; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68151640, jitterRate=0.015538573265075684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,351 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for 124c6c7d3f7a07c87266dcbcd5922857: Writing region info on filesystem at 1675782205331Initializing all the Stores at 1675782205332 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205332Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205332Region opened successfully at 1675782205351 (+19 ms) 2023-02-07 15:03:25,361 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing 124c6c7d3f7a07c87266dcbcd5922857, disabling compactions & flushes 2023-02-07 15:03:25,361 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,361 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,361 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. after waiting 0 ms 2023-02-07 15:03:25,361 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,362 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,362 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for 124c6c7d3f7a07c87266dcbcd5922857: Waiting for close lock at 1675782205361Disabling compacts and flushes for region at 1675782205361Disabling writes for close at 1675782205361Writing region close event to WAL at 1675782205362 (+1 ms)Closed at 1675782205362 2023-02-07 15:03:25,363 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,363 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,365 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,367 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:25,368 DEBUG [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f1 2023-02-07 15:03:25,368 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22bba9af64d7162ee33e53974dde6f1e columnFamilyName f1 2023-02-07 15:03:25,368 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(310): Store=22bba9af64d7162ee33e53974dde6f1e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,369 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:25,369 DEBUG [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f2 2023-02-07 15:03:25,370 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22bba9af64d7162ee33e53974dde6f1e columnFamilyName f2 2023-02-07 15:03:25,370 INFO [StoreOpener-22bba9af64d7162ee33e53974dde6f1e-1] regionserver.HStore(310): Store=22bba9af64d7162ee33e53974dde6f1e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,370 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,370 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened 22bba9af64d7162ee33e53974dde6f1e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70682037, jitterRate=0.05324442684650421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,370 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for 22bba9af64d7162ee33e53974dde6f1e: Writing region info on filesystem at 1675782205365Initializing all the Stores at 1675782205366 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205366Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205366Region opened successfully at 1675782205370 (+4 ms) 2023-02-07 15:03:25,371 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing 22bba9af64d7162ee33e53974dde6f1e, disabling compactions & flushes 2023-02-07 15:03:25,371 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,371 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,371 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. after waiting 0 ms 2023-02-07 15:03:25,371 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,371 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,371 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for 22bba9af64d7162ee33e53974dde6f1e: Waiting for close lock at 1675782205371Disabling compacts and flushes for region at 1675782205371Disabling writes for close at 1675782205371Writing region close event to WAL at 1675782205371Closed at 1675782205371 2023-02-07 15:03:25,371 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,372 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,373 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,374 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:25,375 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1 2023-02-07 15:03:25,375 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cc3bd9568047197cbcc41737dccbcef columnFamilyName f1 2023-02-07 15:03:25,379 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/testWithMockedMapReduceMultiRegion=7cc3bd9568047197cbcc41737dccbcef-92ad557b2e414a398851ce280b829ec5 2023-02-07 15:03:25,379 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(310): Store=7cc3bd9568047197cbcc41737dccbcef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,379 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:25,380 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2 2023-02-07 15:03:25,380 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cc3bd9568047197cbcc41737dccbcef columnFamilyName f2 2023-02-07 15:03:25,384 DEBUG [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/testWithMockedMapReduceMultiRegion=7cc3bd9568047197cbcc41737dccbcef-2e8a3f0bc8394b2f996714bf73aca591 2023-02-07 15:03:25,384 INFO [StoreOpener-7cc3bd9568047197cbcc41737dccbcef-1] regionserver.HStore(310): Store=7cc3bd9568047197cbcc41737dccbcef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,384 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,384 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened 7cc3bd9568047197cbcc41737dccbcef; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61318766, jitterRate=-0.08627918362617493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,384 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for 7cc3bd9568047197cbcc41737dccbcef: Writing region info on filesystem at 1675782205373Initializing all the Stores at 1675782205373Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205373Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205374 (+1 ms)Region opened successfully at 1675782205384 (+10 ms) 2023-02-07 15:03:25,395 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing 7cc3bd9568047197cbcc41737dccbcef, disabling compactions & flushes 2023-02-07 15:03:25,395 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,395 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,395 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. after waiting 0 ms 2023-02-07 15:03:25,395 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,396 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,396 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for 7cc3bd9568047197cbcc41737dccbcef: Waiting for close lock at 1675782205395Disabling compacts and flushes for region at 1675782205395Disabling writes for close at 1675782205395Writing region close event to WAL at 1675782205396 (+1 ms)Closed at 1675782205396 2023-02-07 15:03:25,397 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,397 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,398 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,400 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:25,401 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1 2023-02-07 15:03:25,401 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef20cfe0da07f5897e599c734db8eb58 columnFamilyName f1 2023-02-07 15:03:25,405 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/testWithMockedMapReduceMultiRegion=ef20cfe0da07f5897e599c734db8eb58-cbf1a45f037a497a82161428012041a2 2023-02-07 15:03:25,405 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(310): Store=ef20cfe0da07f5897e599c734db8eb58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,405 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:25,406 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2 2023-02-07 15:03:25,406 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef20cfe0da07f5897e599c734db8eb58 columnFamilyName f2 2023-02-07 15:03:25,410 DEBUG [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/testWithMockedMapReduceMultiRegion=ef20cfe0da07f5897e599c734db8eb58-67d805385335428b95a4d61f1142c63f 2023-02-07 15:03:25,410 INFO [StoreOpener-ef20cfe0da07f5897e599c734db8eb58-1] regionserver.HStore(310): Store=ef20cfe0da07f5897e599c734db8eb58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,410 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,410 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened ef20cfe0da07f5897e599c734db8eb58; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68698500, jitterRate=0.023687422275543213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,410 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for ef20cfe0da07f5897e599c734db8eb58: Writing region info on filesystem at 1675782205398Initializing all the Stores at 1675782205399 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205399Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205399Region opened successfully at 1675782205410 (+11 ms) 2023-02-07 15:03:25,418 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing ef20cfe0da07f5897e599c734db8eb58, disabling compactions & flushes 2023-02-07 15:03:25,419 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,419 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,419 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. after waiting 0 ms 2023-02-07 15:03:25,419 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,420 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,420 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for ef20cfe0da07f5897e599c734db8eb58: Waiting for close lock at 1675782205418Disabling compacts and flushes for region at 1675782205418Disabling writes for close at 1675782205419 (+1 ms)Writing region close event to WAL at 1675782205420 (+1 ms)Closed at 1675782205420 2023-02-07 15:03:25,421 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,421 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,422 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,423 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:25,424 DEBUG [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f1 2023-02-07 15:03:25,424 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74192f33ac005cdd568f16ce85f8d2c2 columnFamilyName f1 2023-02-07 15:03:25,425 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(310): Store=74192f33ac005cdd568f16ce85f8d2c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,425 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:25,426 DEBUG [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f2 2023-02-07 15:03:25,426 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74192f33ac005cdd568f16ce85f8d2c2 columnFamilyName f2 2023-02-07 15:03:25,426 INFO [StoreOpener-74192f33ac005cdd568f16ce85f8d2c2-1] regionserver.HStore(310): Store=74192f33ac005cdd568f16ce85f8d2c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,427 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,427 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened 74192f33ac005cdd568f16ce85f8d2c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63520598, jitterRate=-0.053469330072402954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,427 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for 74192f33ac005cdd568f16ce85f8d2c2: Writing region info on filesystem at 1675782205422Initializing all the Stores at 1675782205422Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205422Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205423 (+1 ms)Region opened successfully at 1675782205427 (+4 ms) 2023-02-07 15:03:25,427 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing 74192f33ac005cdd568f16ce85f8d2c2, disabling compactions & flushes 2023-02-07 15:03:25,427 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,427 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,427 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. after waiting 0 ms 2023-02-07 15:03:25,427 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,427 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,427 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for 74192f33ac005cdd568f16ce85f8d2c2: Waiting for close lock at 1675782205427Disabling compacts and flushes for region at 1675782205427Disabling writes for close at 1675782205427Writing region close event to WAL at 1675782205427Closed at 1675782205427 2023-02-07 15:03:25,428 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,428 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,429 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,430 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:25,431 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1 2023-02-07 15:03:25,431 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de4dd0cd409fe4d62ad5aeb9c63d3465 columnFamilyName f1 2023-02-07 15:03:25,435 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/testWithMockedMapReduceMultiRegion=de4dd0cd409fe4d62ad5aeb9c63d3465-5d1a646a909948d898999fedac177920 2023-02-07 15:03:25,435 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(310): Store=de4dd0cd409fe4d62ad5aeb9c63d3465/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,435 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:25,436 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2 2023-02-07 15:03:25,436 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de4dd0cd409fe4d62ad5aeb9c63d3465 columnFamilyName f2 2023-02-07 15:03:25,440 DEBUG [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/testWithMockedMapReduceMultiRegion=de4dd0cd409fe4d62ad5aeb9c63d3465-106ec9d4b55542238028282ac84f48bc 2023-02-07 15:03:25,440 INFO [StoreOpener-de4dd0cd409fe4d62ad5aeb9c63d3465-1] regionserver.HStore(310): Store=de4dd0cd409fe4d62ad5aeb9c63d3465/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,440 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,440 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened de4dd0cd409fe4d62ad5aeb9c63d3465; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70026052, jitterRate=0.04346948862075806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,440 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for de4dd0cd409fe4d62ad5aeb9c63d3465: Writing region info on filesystem at 1675782205429Initializing all the Stores at 1675782205429Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205430 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205430Region opened successfully at 1675782205440 (+10 ms) 2023-02-07 15:03:25,451 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing de4dd0cd409fe4d62ad5aeb9c63d3465, disabling compactions & flushes 2023-02-07 15:03:25,452 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,452 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,452 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. after waiting 0 ms 2023-02-07 15:03:25,452 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,452 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,452 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for de4dd0cd409fe4d62ad5aeb9c63d3465: Waiting for close lock at 1675782205451Disabling compacts and flushes for region at 1675782205451Disabling writes for close at 1675782205452 (+1 ms)Writing region close event to WAL at 1675782205452Closed at 1675782205452 2023-02-07 15:03:25,453 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,453 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,455 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,456 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:25,457 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1 2023-02-07 15:03:25,457 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6abc99196eeaac57d24e398f1a94e304 columnFamilyName f1 2023-02-07 15:03:25,461 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/testWithMockedMapReduceMultiRegion=6abc99196eeaac57d24e398f1a94e304-c084986af60c481bb468f57cc61e4be6 2023-02-07 15:03:25,461 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(310): Store=6abc99196eeaac57d24e398f1a94e304/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,461 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:25,462 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2 2023-02-07 15:03:25,462 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6abc99196eeaac57d24e398f1a94e304 columnFamilyName f2 2023-02-07 15:03:25,466 DEBUG [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/testWithMockedMapReduceMultiRegion=6abc99196eeaac57d24e398f1a94e304-3c7014a45be240bcbbd7ee03accd9690 2023-02-07 15:03:25,466 INFO [StoreOpener-6abc99196eeaac57d24e398f1a94e304-1] regionserver.HStore(310): Store=6abc99196eeaac57d24e398f1a94e304/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,466 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,466 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened 6abc99196eeaac57d24e398f1a94e304; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73407057, jitterRate=0.09385038912296295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,466 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for 6abc99196eeaac57d24e398f1a94e304: Writing region info on filesystem at 1675782205455Initializing all the Stores at 1675782205455Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205455Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205455Region opened successfully at 1675782205466 (+11 ms) 2023-02-07 15:03:25,474 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing 6abc99196eeaac57d24e398f1a94e304, disabling compactions & flushes 2023-02-07 15:03:25,474 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,474 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,474 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. after waiting 0 ms 2023-02-07 15:03:25,474 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,475 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,475 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for 6abc99196eeaac57d24e398f1a94e304: Waiting for close lock at 1675782205474Disabling compacts and flushes for region at 1675782205474Disabling writes for close at 1675782205474Writing region close event to WAL at 1675782205475 (+1 ms)Closed at 1675782205475 2023-02-07 15:03:25,476 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,476 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,477 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,479 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:25,480 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1 2023-02-07 15:03:25,480 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0c7e502cc37c83c904b4a8353af2747 columnFamilyName f1 2023-02-07 15:03:25,484 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/testWithMockedMapReduceMultiRegion=b0c7e502cc37c83c904b4a8353af2747-9bfde7cdcdc14424ae49c78c3d9d368c 2023-02-07 15:03:25,484 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(310): Store=b0c7e502cc37c83c904b4a8353af2747/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,484 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:25,485 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2 2023-02-07 15:03:25,485 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0c7e502cc37c83c904b4a8353af2747 columnFamilyName f2 2023-02-07 15:03:25,489 DEBUG [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/testWithMockedMapReduceMultiRegion=b0c7e502cc37c83c904b4a8353af2747-521cbd966c3b4629abfddbaf530dd10f 2023-02-07 15:03:25,489 INFO [StoreOpener-b0c7e502cc37c83c904b4a8353af2747-1] regionserver.HStore(310): Store=b0c7e502cc37c83c904b4a8353af2747/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,489 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,489 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened b0c7e502cc37c83c904b4a8353af2747; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60229030, jitterRate=-0.1025175154209137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,489 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for b0c7e502cc37c83c904b4a8353af2747: Writing region info on filesystem at 1675782205477Initializing all the Stores at 1675782205478 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205478Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205478Region opened successfully at 1675782205489 (+11 ms) 2023-02-07 15:03:25,499 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing b0c7e502cc37c83c904b4a8353af2747, disabling compactions & flushes 2023-02-07 15:03:25,499 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,499 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,499 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. after waiting 0 ms 2023-02-07 15:03:25,499 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,504 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,504 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for b0c7e502cc37c83c904b4a8353af2747: Waiting for close lock at 1675782205499Disabling compacts and flushes for region at 1675782205499Disabling writes for close at 1675782205499Writing region close event to WAL at 1675782205504 (+5 ms)Closed at 1675782205504 2023-02-07 15:03:25,505 DEBUG [Listener at localhost/42617] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:25,505 INFO [Listener at localhost/42617] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:25,506 DEBUG [Listener at localhost/42617] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:25,508 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:25,509 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1 2023-02-07 15:03:25,509 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5a441015f7aec14f7fc86d53bcdd714 columnFamilyName f1 2023-02-07 15:03:25,513 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/testWithMockedMapReduceMultiRegion=f5a441015f7aec14f7fc86d53bcdd714-fb3b51238bd64100a2620bbcb2d10d7b 2023-02-07 15:03:25,513 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(310): Store=f5a441015f7aec14f7fc86d53bcdd714/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,513 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:25,514 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2 2023-02-07 15:03:25,514 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5a441015f7aec14f7fc86d53bcdd714 columnFamilyName f2 2023-02-07 15:03:25,519 DEBUG [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(539): loaded hdfs://localhost:35559/user/jenkins/test-data/98275613-c266-43d7-6e7e-fe9f7a5129a2/testWithMockedMapReduceMultiRegion/b844b8c4-4498-45ab-b6b9-dc8d7dba3953/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/testWithMockedMapReduceMultiRegion=f5a441015f7aec14f7fc86d53bcdd714-f7fad8889ebb450ba221d762b37fbe9d 2023-02-07 15:03:25,519 INFO [StoreOpener-f5a441015f7aec14f7fc86d53bcdd714-1] regionserver.HStore(310): Store=f5a441015f7aec14f7fc86d53bcdd714/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:25,519 DEBUG [Listener at localhost/42617] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:25,519 INFO [Listener at localhost/42617] regionserver.HRegion(1071): Opened f5a441015f7aec14f7fc86d53bcdd714; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61841392, jitterRate=-0.0784914493560791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:25,519 DEBUG [Listener at localhost/42617] regionserver.HRegion(964): Region open journal for f5a441015f7aec14f7fc86d53bcdd714: Writing region info on filesystem at 1675782205506Initializing all the Stores at 1675782205507 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205507Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782205507Region opened successfully at 1675782205519 (+12 ms) 2023-02-07 15:03:25,527 DEBUG [Listener at localhost/42617] regionserver.HRegion(1603): Closing f5a441015f7aec14f7fc86d53bcdd714, disabling compactions & flushes 2023-02-07 15:03:25,528 INFO [Listener at localhost/42617] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,528 DEBUG [Listener at localhost/42617] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,528 DEBUG [Listener at localhost/42617] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. after waiting 0 ms 2023-02-07 15:03:25,528 DEBUG [Listener at localhost/42617] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,530 INFO [Listener at localhost/42617] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,530 DEBUG [Listener at localhost/42617] regionserver.HRegion(1557): Region close journal for f5a441015f7aec14f7fc86d53bcdd714: Waiting for close lock at 1675782205527Disabling compacts and flushes for region at 1675782205527Disabling writes for close at 1675782205528 (+1 ms)Writing region close event to WAL at 1675782205530 (+2 ms)Closed at 1675782205530 2023-02-07 15:03:25,534 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,534 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-07 15:03:25,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,537 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,538 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,538 INFO [Listener at localhost/42617] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,541 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,541 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782205542"}]},"ts":"1675782205542"} 2023-02-07 15:03:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 15:03:25,543 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-07 15:03:25,545 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-07 15:03:25,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=22bba9af64d7162ee33e53974dde6f1e, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=124c6c7d3f7a07c87266dcbcd5922857, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9c2e037e417bc7fcf13f24e7af86bbce, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6abc99196eeaac57d24e398f1a94e304, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef20cfe0da07f5897e599c734db8eb58, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5a441015f7aec14f7fc86d53bcdd714, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de4dd0cd409fe4d62ad5aeb9c63d3465, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0c7e502cc37c83c904b4a8353af2747, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cc3bd9568047197cbcc41737dccbcef, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=74192f33ac005cdd568f16ce85f8d2c2, UNASSIGN}] 2023-02-07 15:03:25,547 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=124c6c7d3f7a07c87266dcbcd5922857, UNASSIGN 2023-02-07 15:03:25,548 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9c2e037e417bc7fcf13f24e7af86bbce, UNASSIGN 2023-02-07 15:03:25,548 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=22bba9af64d7162ee33e53974dde6f1e, UNASSIGN 2023-02-07 15:03:25,548 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6abc99196eeaac57d24e398f1a94e304, UNASSIGN 2023-02-07 15:03:25,548 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=124c6c7d3f7a07c87266dcbcd5922857, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:25,548 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=74192f33ac005cdd568f16ce85f8d2c2, UNASSIGN 2023-02-07 15:03:25,548 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205548"}]},"ts":"1675782205548"} 2023-02-07 15:03:25,548 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9c2e037e417bc7fcf13f24e7af86bbce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:25,548 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=22bba9af64d7162ee33e53974dde6f1e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:25,549 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205548"}]},"ts":"1675782205548"} 2023-02-07 15:03:25,549 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782205548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205548"}]},"ts":"1675782205548"} 2023-02-07 15:03:25,549 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6abc99196eeaac57d24e398f1a94e304, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:25,549 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205549"}]},"ts":"1675782205549"} 2023-02-07 15:03:25,549 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=74192f33ac005cdd568f16ce85f8d2c2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:25,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782205549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205549"}]},"ts":"1675782205549"} 2023-02-07 15:03:25,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure 124c6c7d3f7a07c87266dcbcd5922857, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:25,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 9c2e037e417bc7fcf13f24e7af86bbce, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:25,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=34, state=RUNNABLE; CloseRegionProcedure 22bba9af64d7162ee33e53974dde6f1e, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:25,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure 6abc99196eeaac57d24e398f1a94e304, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:25,552 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cc3bd9568047197cbcc41737dccbcef, UNASSIGN 2023-02-07 15:03:25,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 74192f33ac005cdd568f16ce85f8d2c2, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:25,553 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7cc3bd9568047197cbcc41737dccbcef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:25,553 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0c7e502cc37c83c904b4a8353af2747, UNASSIGN 2023-02-07 15:03:25,553 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205553"}]},"ts":"1675782205553"} 2023-02-07 15:03:25,554 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b0c7e502cc37c83c904b4a8353af2747, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:25,554 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de4dd0cd409fe4d62ad5aeb9c63d3465, UNASSIGN 2023-02-07 15:03:25,554 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205554"}]},"ts":"1675782205554"} 2023-02-07 15:03:25,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 7cc3bd9568047197cbcc41737dccbcef, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:25,555 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=de4dd0cd409fe4d62ad5aeb9c63d3465, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:25,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205555"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205555"}]},"ts":"1675782205555"} 2023-02-07 15:03:25,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure b0c7e502cc37c83c904b4a8353af2747, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:25,555 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5a441015f7aec14f7fc86d53bcdd714, UNASSIGN 2023-02-07 15:03:25,556 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f5a441015f7aec14f7fc86d53bcdd714, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:25,556 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205556"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205556"}]},"ts":"1675782205556"} 2023-02-07 15:03:25,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure de4dd0cd409fe4d62ad5aeb9c63d3465, server=jenkins-hbase4.apache.org,34587,1675782200572}] 2023-02-07 15:03:25,556 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef20cfe0da07f5897e599c734db8eb58, UNASSIGN 2023-02-07 15:03:25,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ef20cfe0da07f5897e599c734db8eb58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:25,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782205557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782205557"}]},"ts":"1675782205557"} 2023-02-07 15:03:25,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure f5a441015f7aec14f7fc86d53bcdd714, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:25,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure ef20cfe0da07f5897e599c734db8eb58, server=jenkins-hbase4.apache.org,40501,1675782200546}] 2023-02-07 15:03:25,642 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,643 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 15:03:25,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 74192f33ac005cdd568f16ce85f8d2c2, disabling compactions & flushes 2023-02-07 15:03:25,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. after waiting 0 ms 2023-02-07 15:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:25,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9c2e037e417bc7fcf13f24e7af86bbce, disabling compactions & flushes 2023-02-07 15:03:25,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. after waiting 0 ms 2023-02-07 15:03:25,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 15:03:25,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2. 2023-02-07 15:03:25,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 74192f33ac005cdd568f16ce85f8d2c2: Waiting for close lock at 1675782205702Running coprocessor pre-close hooks at 1675782205702Disabling compacts and flushes for region at 1675782205702Disabling writes for close at 1675782205702Writing region close event to WAL at 1675782205703 (+1 ms)Running coprocessor post-close hooks at 1675782205706 (+3 ms)Closed at 1675782205706 2023-02-07 15:03:25,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce. 2023-02-07 15:03:25,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9c2e037e417bc7fcf13f24e7af86bbce: Waiting for close lock at 1675782205703Running coprocessor pre-close hooks at 1675782205703Disabling compacts and flushes for region at 1675782205703Disabling writes for close at 1675782205703Writing region close event to WAL at 1675782205704 (+1 ms)Running coprocessor post-close hooks at 1675782205707 (+3 ms)Closed at 1675782205707 2023-02-07 15:03:25,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:25,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:25,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef20cfe0da07f5897e599c734db8eb58, disabling compactions & flushes 2023-02-07 15:03:25,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. after waiting 0 ms 2023-02-07 15:03:25,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,708 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=74192f33ac005cdd568f16ce85f8d2c2, regionState=CLOSED 2023-02-07 15:03:25,708 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782205708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205708"}]},"ts":"1675782205708"} 2023-02-07 15:03:25,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:25,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:25,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 22bba9af64d7162ee33e53974dde6f1e, disabling compactions & flushes 2023-02-07 15:03:25,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. after waiting 0 ms 2023-02-07 15:03:25,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9c2e037e417bc7fcf13f24e7af86bbce, regionState=CLOSED 2023-02-07 15:03:25,709 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205709"}]},"ts":"1675782205709"} 2023-02-07 15:03:25,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-07 15:03:25,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 74192f33ac005cdd568f16ce85f8d2c2, server=jenkins-hbase4.apache.org,40501,1675782200546 in 157 msec 2023-02-07 15:03:25,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-07 15:03:25,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 9c2e037e417bc7fcf13f24e7af86bbce, server=jenkins-hbase4.apache.org,34587,1675782200572 in 161 msec 2023-02-07 15:03:25,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=74192f33ac005cdd568f16ce85f8d2c2, UNASSIGN in 167 msec 2023-02-07 15:03:25,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9c2e037e417bc7fcf13f24e7af86bbce, UNASSIGN in 167 msec 2023-02-07 15:03:25,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58. 2023-02-07 15:03:25,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef20cfe0da07f5897e599c734db8eb58: Waiting for close lock at 1675782205708Running coprocessor pre-close hooks at 1675782205708Disabling compacts and flushes for region at 1675782205708Disabling writes for close at 1675782205708Writing region close event to WAL at 1675782205709 (+1 ms)Running coprocessor post-close hooks at 1675782205714 (+5 ms)Closed at 1675782205714 2023-02-07 15:03:25,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:25,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:25,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 124c6c7d3f7a07c87266dcbcd5922857, disabling compactions & flushes 2023-02-07 15:03:25,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ef20cfe0da07f5897e599c734db8eb58, regionState=CLOSED 2023-02-07 15:03:25,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. after waiting 0 ms 2023-02-07 15:03:25,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205716"}]},"ts":"1675782205716"} 2023-02-07 15:03:25,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-07 15:03:25,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure ef20cfe0da07f5897e599c734db8eb58, server=jenkins-hbase4.apache.org,40501,1675782200546 in 156 msec 2023-02-07 15:03:25,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef20cfe0da07f5897e599c734db8eb58, UNASSIGN in 173 msec 2023-02-07 15:03:25,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857. 2023-02-07 15:03:25,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 124c6c7d3f7a07c87266dcbcd5922857: Waiting for close lock at 1675782205715Running coprocessor pre-close hooks at 1675782205715Disabling compacts and flushes for region at 1675782205715Disabling writes for close at 1675782205716 (+1 ms)Writing region close event to WAL at 1675782205717 (+1 ms)Running coprocessor post-close hooks at 1675782205720 (+3 ms)Closed at 1675782205720 2023-02-07 15:03:25,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 15:03:25,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e. 2023-02-07 15:03:25,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 22bba9af64d7162ee33e53974dde6f1e: Waiting for close lock at 1675782205709Running coprocessor pre-close hooks at 1675782205709Disabling compacts and flushes for region at 1675782205709Disabling writes for close at 1675782205709Writing region close event to WAL at 1675782205709Running coprocessor post-close hooks at 1675782205720 (+11 ms)Closed at 1675782205721 (+1 ms) 2023-02-07 15:03:25,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:25,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:25,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f5a441015f7aec14f7fc86d53bcdd714, disabling compactions & flushes 2023-02-07 15:03:25,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. after waiting 0 ms 2023-02-07 15:03:25,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,721 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=124c6c7d3f7a07c87266dcbcd5922857, regionState=CLOSED 2023-02-07 15:03:25,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205721"}]},"ts":"1675782205721"} 2023-02-07 15:03:25,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:25,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:25,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7cc3bd9568047197cbcc41737dccbcef, disabling compactions & flushes 2023-02-07 15:03:25,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,722 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=22bba9af64d7162ee33e53974dde6f1e, regionState=CLOSED 2023-02-07 15:03:25,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. after waiting 0 ms 2023-02-07 15:03:25,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,722 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675782205722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205722"}]},"ts":"1675782205722"} 2023-02-07 15:03:25,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-07 15:03:25,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure 124c6c7d3f7a07c87266dcbcd5922857, server=jenkins-hbase4.apache.org,40501,1675782200546 in 173 msec 2023-02-07 15:03:25,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=124c6c7d3f7a07c87266dcbcd5922857, UNASSIGN in 180 msec 2023-02-07 15:03:25,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714. 2023-02-07 15:03:25,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f5a441015f7aec14f7fc86d53bcdd714: Waiting for close lock at 1675782205721Running coprocessor pre-close hooks at 1675782205721Disabling compacts and flushes for region at 1675782205721Disabling writes for close at 1675782205721Writing region close event to WAL at 1675782205723 (+2 ms)Running coprocessor post-close hooks at 1675782205727 (+4 ms)Closed at 1675782205727 2023-02-07 15:03:25,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=34 2023-02-07 15:03:25,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=34, state=SUCCESS; CloseRegionProcedure 22bba9af64d7162ee33e53974dde6f1e, server=jenkins-hbase4.apache.org,34587,1675782200572 in 174 msec 2023-02-07 15:03:25,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=22bba9af64d7162ee33e53974dde6f1e, UNASSIGN in 183 msec 2023-02-07 15:03:25,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:25,729 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f5a441015f7aec14f7fc86d53bcdd714, regionState=CLOSED 2023-02-07 15:03:25,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:25,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b0c7e502cc37c83c904b4a8353af2747, disabling compactions & flushes 2023-02-07 15:03:25,729 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205729"}]},"ts":"1675782205729"} 2023-02-07 15:03:25,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. after waiting 0 ms 2023-02-07 15:03:25,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef. 2023-02-07 15:03:25,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7cc3bd9568047197cbcc41737dccbcef: Waiting for close lock at 1675782205722Running coprocessor pre-close hooks at 1675782205722Disabling compacts and flushes for region at 1675782205722Disabling writes for close at 1675782205722Writing region close event to WAL at 1675782205724 (+2 ms)Running coprocessor post-close hooks at 1675782205730 (+6 ms)Closed at 1675782205730 2023-02-07 15:03:25,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:25,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:25,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing de4dd0cd409fe4d62ad5aeb9c63d3465, disabling compactions & flushes 2023-02-07 15:03:25,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7cc3bd9568047197cbcc41737dccbcef, regionState=CLOSED 2023-02-07 15:03:25,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. after waiting 0 ms 2023-02-07 15:03:25,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,732 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205732"}]},"ts":"1675782205732"} 2023-02-07 15:03:25,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-07 15:03:25,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure f5a441015f7aec14f7fc86d53bcdd714, server=jenkins-hbase4.apache.org,40501,1675782200546 in 176 msec 2023-02-07 15:03:25,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-07 15:03:25,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5a441015f7aec14f7fc86d53bcdd714, UNASSIGN in 190 msec 2023-02-07 15:03:25,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 7cc3bd9568047197cbcc41737dccbcef, server=jenkins-hbase4.apache.org,34587,1675782200572 in 180 msec 2023-02-07 15:03:25,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cc3bd9568047197cbcc41737dccbcef, UNASSIGN in 191 msec 2023-02-07 15:03:25,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747. 2023-02-07 15:03:25,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b0c7e502cc37c83c904b4a8353af2747: Waiting for close lock at 1675782205729Running coprocessor pre-close hooks at 1675782205729Disabling compacts and flushes for region at 1675782205729Disabling writes for close at 1675782205729Writing region close event to WAL at 1675782205733 (+4 ms)Running coprocessor post-close hooks at 1675782205737 (+4 ms)Closed at 1675782205737 2023-02-07 15:03:25,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465. 2023-02-07 15:03:25,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for de4dd0cd409fe4d62ad5aeb9c63d3465: Waiting for close lock at 1675782205731Running coprocessor pre-close hooks at 1675782205731Disabling compacts and flushes for region at 1675782205731Disabling writes for close at 1675782205732 (+1 ms)Writing region close event to WAL at 1675782205734 (+2 ms)Running coprocessor post-close hooks at 1675782205737 (+3 ms)Closed at 1675782205737 2023-02-07 15:03:25,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:25,739 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b0c7e502cc37c83c904b4a8353af2747, regionState=CLOSED 2023-02-07 15:03:25,739 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205739"}]},"ts":"1675782205739"} 2023-02-07 15:03:25,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:25,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:25,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6abc99196eeaac57d24e398f1a94e304, disabling compactions & flushes 2023-02-07 15:03:25,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. after waiting 0 ms 2023-02-07 15:03:25,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,739 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=de4dd0cd409fe4d62ad5aeb9c63d3465, regionState=CLOSED 2023-02-07 15:03:25,740 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205739"}]},"ts":"1675782205739"} 2023-02-07 15:03:25,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-07 15:03:25,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure b0c7e502cc37c83c904b4a8353af2747, server=jenkins-hbase4.apache.org,40501,1675782200546 in 185 msec 2023-02-07 15:03:25,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-07 15:03:25,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure de4dd0cd409fe4d62ad5aeb9c63d3465, server=jenkins-hbase4.apache.org,34587,1675782200572 in 185 msec 2023-02-07 15:03:25,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0c7e502cc37c83c904b4a8353af2747, UNASSIGN in 197 msec 2023-02-07 15:03:25,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de4dd0cd409fe4d62ad5aeb9c63d3465, UNASSIGN in 197 msec 2023-02-07 15:03:25,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:25,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304. 2023-02-07 15:03:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6abc99196eeaac57d24e398f1a94e304: Waiting for close lock at 1675782205739Running coprocessor pre-close hooks at 1675782205739Disabling compacts and flushes for region at 1675782205739Disabling writes for close at 1675782205739Writing region close event to WAL at 1675782205744 (+5 ms)Running coprocessor post-close hooks at 1675782205746 (+2 ms)Closed at 1675782205747 (+1 ms) 2023-02-07 15:03:25,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:25,748 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6abc99196eeaac57d24e398f1a94e304, regionState=CLOSED 2023-02-07 15:03:25,748 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675782205748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782205748"}]},"ts":"1675782205748"} 2023-02-07 15:03:25,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-07 15:03:25,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure 6abc99196eeaac57d24e398f1a94e304, server=jenkins-hbase4.apache.org,34587,1675782200572 in 197 msec 2023-02-07 15:03:25,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-07 15:03:25,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6abc99196eeaac57d24e398f1a94e304, UNASSIGN in 205 msec 2023-02-07 15:03:25,752 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782205752"}]},"ts":"1675782205752"} 2023-02-07 15:03:25,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-07 15:03:25,754 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-07 15:03:25,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 216 msec 2023-02-07 15:03:25,844 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,844 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 15:03:25,846 INFO [Listener at localhost/42617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-07 15:03:25,846 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,846 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,849 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,850 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,850 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,850 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:25,860 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:25,864 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/recovered.edits] 2023-02-07 15:03:25,864 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/recovered.edits] 2023-02-07 15:03:25,864 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/recovered.edits] 2023-02-07 15:03:25,865 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/recovered.edits] 2023-02-07 15:03:25,866 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/recovered.edits] 2023-02-07 15:03:25,866 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/recovered.edits] 2023-02-07 15:03:25,867 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/recovered.edits] 2023-02-07 15:03:25,867 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/recovered.edits] 2023-02-07 15:03:25,871 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/a43cd88ed4334d9c97b03f5e87b4ddec to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/a43cd88ed4334d9c97b03f5e87b4ddec 2023-02-07 15:03:25,872 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/526d8b17d5ce4c8382cfe88fa4891986 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/526d8b17d5ce4c8382cfe88fa4891986 2023-02-07 15:03:25,873 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/3fb8b296a1fc45ecb96cbda51d12014c to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/3fb8b296a1fc45ecb96cbda51d12014c 2023-02-07 15:03:25,874 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/2a80455e63e6465794a879b10b55bad2 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/2a80455e63e6465794a879b10b55bad2 2023-02-07 15:03:25,874 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/d3fb8c6c7e4b4c6a9f7f65afa70f83cb to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f1/d3fb8c6c7e4b4c6a9f7f65afa70f83cb 2023-02-07 15:03:25,874 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/5d1a646a909948d898999fedac177920 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/5d1a646a909948d898999fedac177920 2023-02-07 15:03:25,875 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/recovered.edits/6.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e/recovered.edits/6.seqid 2023-02-07 15:03:25,875 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/22bba9af64d7162ee33e53974dde6f1e 2023-02-07 15:03:25,875 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:25,876 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/911baa3e037645c6be8f2594d2ab1358 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/911baa3e037645c6be8f2594d2ab1358 2023-02-07 15:03:25,876 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/fb3b51238bd64100a2620bbcb2d10d7b to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f1/fb3b51238bd64100a2620bbcb2d10d7b 2023-02-07 15:03:25,876 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9bfde7cdcdc14424ae49c78c3d9d368c to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9bfde7cdcdc14424ae49c78c3d9d368c 2023-02-07 15:03:25,877 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/a8965d06703145d7b12bbaebccddf05c to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f1/a8965d06703145d7b12bbaebccddf05c 2023-02-07 15:03:25,877 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/c084986af60c481bb468f57cc61e4be6 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f1/c084986af60c481bb468f57cc61e4be6 2023-02-07 15:03:25,878 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/9de948c379ea40b4aa89b25001109c59 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f1/9de948c379ea40b4aa89b25001109c59 2023-02-07 15:03:25,879 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/cbf1a45f037a497a82161428012041a2 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f1/cbf1a45f037a497a82161428012041a2 2023-02-07 15:03:25,879 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9d171a29cbe84b4bb021033aeb322dec to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f1/9d171a29cbe84b4bb021033aeb322dec 2023-02-07 15:03:25,880 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/recovered.edits] 2023-02-07 15:03:25,880 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/b834a4eb23794b7bb1af3514ede02ed9 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/b834a4eb23794b7bb1af3514ede02ed9 2023-02-07 15:03:25,883 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/4fcaba6867574de0949fccd6ef4100ab to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/4fcaba6867574de0949fccd6ef4100ab 2023-02-07 15:03:25,884 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/f32ab4ccef504fa3b8903e3f5c417f47 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/f2/f32ab4ccef504fa3b8903e3f5c417f47 2023-02-07 15:03:25,886 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/b173c99bb6f94e86b2db8a9bd66b8023 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/b173c99bb6f94e86b2db8a9bd66b8023 2023-02-07 15:03:25,887 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/335e3e9c44244ad4b34f80e13bb37b35 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/335e3e9c44244ad4b34f80e13bb37b35 2023-02-07 15:03:25,887 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/11c4e40fadf4468180c04b46bc8c4986 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/11c4e40fadf4468180c04b46bc8c4986 2023-02-07 15:03:25,887 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/f7fad8889ebb450ba221d762b37fbe9d to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/f2/f7fad8889ebb450ba221d762b37fbe9d 2023-02-07 15:03:25,887 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/106ec9d4b55542238028282ac84f48bc to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/106ec9d4b55542238028282ac84f48bc 2023-02-07 15:03:25,888 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/92ad557b2e414a398851ce280b829ec5 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/92ad557b2e414a398851ce280b829ec5 2023-02-07 15:03:25,888 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/521cbd966c3b4629abfddbaf530dd10f to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/521cbd966c3b4629abfddbaf530dd10f 2023-02-07 15:03:25,893 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/3c7014a45be240bcbbd7ee03accd9690 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/f2/3c7014a45be240bcbbd7ee03accd9690 2023-02-07 15:03:25,894 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce/recovered.edits/12.seqid 2023-02-07 15:03:25,894 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/de1be1a2fc6f4237b442c3a84d928e8b to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/f2/de1be1a2fc6f4237b442c3a84d928e8b 2023-02-07 15:03:25,894 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/67d805385335428b95a4d61f1142c63f to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/f2/67d805385335428b95a4d61f1142c63f 2023-02-07 15:03:25,894 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/52e588ecba4243ebb43cc4680bf5111c to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/f2/52e588ecba4243ebb43cc4680bf5111c 2023-02-07 15:03:25,895 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/7758ddbf497e4fe49e020f3cc6e47ea0 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/f2/7758ddbf497e4fe49e020f3cc6e47ea0 2023-02-07 15:03:25,895 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/bc2ce9022082497cb2a078761d15024a to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f1/bc2ce9022082497cb2a078761d15024a 2023-02-07 15:03:25,898 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714/recovered.edits/12.seqid 2023-02-07 15:03:25,899 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5a441015f7aec14f7fc86d53bcdd714 2023-02-07 15:03:25,899 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:25,899 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304/recovered.edits/12.seqid 2023-02-07 15:03:25,901 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/6abc99196eeaac57d24e398f1a94e304 2023-02-07 15:03:25,901 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58/recovered.edits/12.seqid 2023-02-07 15:03:25,901 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857/recovered.edits/12.seqid 2023-02-07 15:03:25,901 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465/recovered.edits/12.seqid 2023-02-07 15:03:25,901 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/2e8a3f0bc8394b2f996714bf73aca591 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/2e8a3f0bc8394b2f996714bf73aca591 2023-02-07 15:03:25,902 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747/recovered.edits/12.seqid 2023-02-07 15:03:25,902 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/124c6c7d3f7a07c87266dcbcd5922857 2023-02-07 15:03:25,902 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/de4dd0cd409fe4d62ad5aeb9c63d3465 2023-02-07 15:03:25,902 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f1, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/f2, FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/recovered.edits] 2023-02-07 15:03:25,903 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef20cfe0da07f5897e599c734db8eb58 2023-02-07 15:03:25,903 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0c7e502cc37c83c904b4a8353af2747 2023-02-07 15:03:25,904 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/94c0cce133ef463c854237f40e9aace1 to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/f2/94c0cce133ef463c854237f40e9aace1 2023-02-07 15:03:25,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/9c2e037e417bc7fcf13f24e7af86bbce 2023-02-07 15:03:25,909 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/recovered.edits/12.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef/recovered.edits/12.seqid 2023-02-07 15:03:25,910 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cc3bd9568047197cbcc41737dccbcef 2023-02-07 15:03:25,911 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/recovered.edits/6.seqid to hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/archive/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2/recovered.edits/6.seqid 2023-02-07 15:03:25,912 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/.tmp/data/default/testWithMockedMapReduceMultiRegion/74192f33ac005cdd568f16ce85f8d2c2 2023-02-07 15:03:25,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-07 15:03:25,914 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,917 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-07 15:03:25,920 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-07 15:03:25,921 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,921 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782205921"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,924 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-07 15:03:25,924 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 22bba9af64d7162ee33e53974dde6f1e, NAME => 'testWithMockedMapReduceMultiRegion,,1675782201826.22bba9af64d7162ee33e53974dde6f1e.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 124c6c7d3f7a07c87266dcbcd5922857, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675782201826.124c6c7d3f7a07c87266dcbcd5922857.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 9c2e037e417bc7fcf13f24e7af86bbce, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675782201826.9c2e037e417bc7fcf13f24e7af86bbce.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 6abc99196eeaac57d24e398f1a94e304, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675782201826.6abc99196eeaac57d24e398f1a94e304.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => ef20cfe0da07f5897e599c734db8eb58, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675782201826.ef20cfe0da07f5897e599c734db8eb58.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => f5a441015f7aec14f7fc86d53bcdd714, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675782201826.f5a441015f7aec14f7fc86d53bcdd714.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => de4dd0cd409fe4d62ad5aeb9c63d3465, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675782201826.de4dd0cd409fe4d62ad5aeb9c63d3465.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => b0c7e502cc37c83c904b4a8353af2747, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675782201826.b0c7e502cc37c83c904b4a8353af2747.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 7cc3bd9568047197cbcc41737dccbcef, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675782201826.7cc3bd9568047197cbcc41737dccbcef.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 74192f33ac005cdd568f16ce85f8d2c2, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675782201826.74192f33ac005cdd568f16ce85f8d2c2.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-07 15:03:25,925 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-07 15:03:25,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675782205925"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:25,926 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-07 15:03:25,928 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 15:03:25,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 81 msec 2023-02-07 15:03:25,951 INFO [Listener at localhost/42617] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:25,951 INFO [Listener at localhost/42617] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:25,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 15:03:25,953 INFO [Listener at localhost/42617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-07 15:03:25,953 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 15:03:25,953 INFO [Listener at localhost/42617] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 15:03:25,953 DEBUG [Listener at localhost/42617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x081b8317 to 127.0.0.1:50579 2023-02-07 15:03:25,953 DEBUG [Listener at localhost/42617] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:25,954 DEBUG [Listener at localhost/42617] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 15:03:25,954 DEBUG [Listener at localhost/42617] util.JVMClusterUtil(257): Found active master hash=731704972, stopped=false 2023-02-07 15:03:25,954 INFO [Listener at localhost/42617] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:25,956 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:25,956 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:25,956 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:25,956 INFO [Listener at localhost/42617] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 15:03:25,956 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:25,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:25,958 DEBUG [Listener at localhost/42617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bce7662 to 127.0.0.1:50579 2023-02-07 15:03:25,958 DEBUG [Listener at localhost/42617] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:25,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:25,959 INFO [Listener at localhost/42617] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40501,1675782200546' ***** 2023-02-07 15:03:25,959 INFO [Listener at localhost/42617] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:25,959 INFO [Listener at localhost/42617] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34587,1675782200572' ***** 2023-02-07 15:03:25,959 INFO [Listener at localhost/42617] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:25,959 INFO [RS:0;jenkins-hbase4:40501] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:25,959 INFO [RS:0;jenkins-hbase4:40501] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:25,959 INFO [RS:0;jenkins-hbase4:40501] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:25,959 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:25,959 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:25,959 DEBUG [RS:0;jenkins-hbase4:40501] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x665b7fd1 to 127.0.0.1:50579 2023-02-07 15:03:25,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:25,960 DEBUG [RS:0;jenkins-hbase4:40501] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:25,960 INFO [RS:0;jenkins-hbase4:40501] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:25,960 INFO [RS:0;jenkins-hbase4:40501] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:25,960 INFO [RS:0;jenkins-hbase4:40501] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:25,961 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 15:03:25,961 INFO [RS:1;jenkins-hbase4:34587] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:25,961 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:25,961 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 15:03:25,961 DEBUG [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:25,962 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:25,962 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:25,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:25,962 INFO [RS:1;jenkins-hbase4:34587] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:25,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:25,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:25,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:25,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-07 15:03:25,963 INFO [RS:1;jenkins-hbase4:34587] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:25,963 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(3304): Received CLOSE for d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:25,963 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:25,963 DEBUG [RS:1;jenkins-hbase4:34587] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08acd93f to 127.0.0.1:50579 2023-02-07 15:03:25,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d0850efa5840b80788bb42a012a34b66, disabling compactions & flushes 2023-02-07 15:03:25,965 DEBUG [RS:1;jenkins-hbase4:34587] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:25,965 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:25,965 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1479): Online Regions={d0850efa5840b80788bb42a012a34b66=hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66.} 2023-02-07 15:03:25,965 DEBUG [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1505): Waiting on d0850efa5840b80788bb42a012a34b66 2023-02-07 15:03:25,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:25,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:25,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. after waiting 0 ms 2023-02-07 15:03:25,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:25,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d0850efa5840b80788bb42a012a34b66 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 15:03:25,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/.tmp/info/37f3166668da429c8f00c70dd515c4a6 2023-02-07 15:03:25,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/.tmp/info/f18524e7e491400a81ab320d16d2aa8d 2023-02-07 15:03:25,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/.tmp/info/37f3166668da429c8f00c70dd515c4a6 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/info/37f3166668da429c8f00c70dd515c4a6 2023-02-07 15:03:25,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f18524e7e491400a81ab320d16d2aa8d 2023-02-07 15:03:25,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/info/37f3166668da429c8f00c70dd515c4a6, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 15:03:25,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d0850efa5840b80788bb42a012a34b66 in 21ms, sequenceid=6, compaction requested=false 2023-02-07 15:03:25,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/.tmp/rep_barrier/fc785e054ab04b7d83c3ee588078386c 2023-02-07 15:03:25,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/namespace/d0850efa5840b80788bb42a012a34b66/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 15:03:25,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:25,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d0850efa5840b80788bb42a012a34b66: Waiting for close lock at 1675782205963Running coprocessor pre-close hooks at 1675782205963Disabling compacts and flushes for region at 1675782205963Disabling writes for close at 1675782205966 (+3 ms)Obtaining lock to block concurrent updates at 1675782205966Preparing flush snapshotting stores in d0850efa5840b80788bb42a012a34b66 at 1675782205966Finished memstore snapshotting hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675782205966Flushing stores of hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. at 1675782205966Flushing d0850efa5840b80788bb42a012a34b66/info: creating writer at 1675782205966Flushing d0850efa5840b80788bb42a012a34b66/info: appending metadata at 1675782205968 (+2 ms)Flushing d0850efa5840b80788bb42a012a34b66/info: closing flushed file at 1675782205968Flushing d0850efa5840b80788bb42a012a34b66/info: reopening flushed file at 1675782205982 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d0850efa5840b80788bb42a012a34b66 in 21ms, sequenceid=6, compaction requested=false at 1675782205987 (+5 ms)Writing region close event to WAL at 1675782205988 (+1 ms)Running coprocessor post-close hooks at 1675782205992 (+4 ms)Closed at 1675782205993 (+1 ms) 2023-02-07 15:03:25,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675782201155.d0850efa5840b80788bb42a012a34b66. 2023-02-07 15:03:25,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc785e054ab04b7d83c3ee588078386c 2023-02-07 15:03:26,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/.tmp/table/47ce47c1705f45c5bf9a3a7eb75996c9 2023-02-07 15:03:26,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47ce47c1705f45c5bf9a3a7eb75996c9 2023-02-07 15:03:26,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/.tmp/info/f18524e7e491400a81ab320d16d2aa8d as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/info/f18524e7e491400a81ab320d16d2aa8d 2023-02-07 15:03:26,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f18524e7e491400a81ab320d16d2aa8d 2023-02-07 15:03:26,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/info/f18524e7e491400a81ab320d16d2aa8d, entries=30, sequenceid=57, filesize=8.3 K 2023-02-07 15:03:26,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/.tmp/rep_barrier/fc785e054ab04b7d83c3ee588078386c as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/rep_barrier/fc785e054ab04b7d83c3ee588078386c 2023-02-07 15:03:26,025 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc785e054ab04b7d83c3ee588078386c 2023-02-07 15:03:26,025 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/rep_barrier/fc785e054ab04b7d83c3ee588078386c, entries=10, sequenceid=57, filesize=6.1 K 2023-02-07 15:03:26,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/.tmp/table/47ce47c1705f45c5bf9a3a7eb75996c9 as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/table/47ce47c1705f45c5bf9a3a7eb75996c9 2023-02-07 15:03:26,030 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47ce47c1705f45c5bf9a3a7eb75996c9 2023-02-07 15:03:26,030 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/table/47ce47c1705f45c5bf9a3a7eb75996c9, entries=13, sequenceid=57, filesize=6.1 K 2023-02-07 15:03:26,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=57, compaction requested=false 2023-02-07 15:03:26,035 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-07 15:03:26,035 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:26,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:26,037 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782205961Running coprocessor pre-close hooks at 1675782205961Disabling compacts and flushes for region at 1675782205961Disabling writes for close at 1675782205963 (+2 ms)Obtaining lock to block concurrent updates at 1675782205963Preparing flush snapshotting stores in 1588230740 at 1675782205963Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675782205965 (+2 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675782205966 (+1 ms)Flushing 1588230740/info: creating writer at 1675782205966Flushing 1588230740/info: appending metadata at 1675782205968 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675782205968Flushing 1588230740/rep_barrier: creating writer at 1675782205982 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675782205984 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675782205984Flushing 1588230740/table: creating writer at 1675782205997 (+13 ms)Flushing 1588230740/table: appending metadata at 1675782205999 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675782205999Flushing 1588230740/info: reopening flushed file at 1675782206016 (+17 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675782206021 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675782206026 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=57, compaction requested=false at 1675782206031 (+5 ms)Writing region close event to WAL at 1675782206032 (+1 ms)Running coprocessor post-close hooks at 1675782206035 (+3 ms)Closed at 1675782206036 (+1 ms) 2023-02-07 15:03:26,037 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:26,048 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:26,048 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:26,162 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40501,1675782200546; all regions closed. 2023-02-07 15:03:26,166 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34587,1675782200572; all regions closed. 2023-02-07 15:03:26,167 DEBUG [RS:0;jenkins-hbase4:40501] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/oldWALs 2023-02-07 15:03:26,167 INFO [RS:0;jenkins-hbase4:40501] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40501%2C1675782200546.meta:.meta(num 1675782201098) 2023-02-07 15:03:26,170 DEBUG [RS:1;jenkins-hbase4:34587] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/oldWALs 2023-02-07 15:03:26,170 INFO [RS:1;jenkins-hbase4:34587] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34587%2C1675782200572:(num 1675782201520) 2023-02-07 15:03:26,170 DEBUG [RS:1;jenkins-hbase4:34587] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:26,170 INFO [RS:1;jenkins-hbase4:34587] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:26,170 INFO [RS:1;jenkins-hbase4:34587] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:26,170 INFO [RS:1;jenkins-hbase4:34587] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:26,170 INFO [RS:1;jenkins-hbase4:34587] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:26,170 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:26,170 INFO [RS:1;jenkins-hbase4:34587] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:26,171 INFO [RS:1;jenkins-hbase4:34587] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34587 2023-02-07 15:03:26,172 DEBUG [RS:0;jenkins-hbase4:40501] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/oldWALs 2023-02-07 15:03:26,172 INFO [RS:0;jenkins-hbase4:40501] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40501%2C1675782200546:(num 1675782201875) 2023-02-07 15:03:26,172 DEBUG [RS:0;jenkins-hbase4:40501] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:26,172 INFO [RS:0;jenkins-hbase4:40501] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:26,173 INFO [RS:0;jenkins-hbase4:40501] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:26,173 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:26,174 INFO [RS:0;jenkins-hbase4:40501] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40501 2023-02-07 15:03:26,174 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:26,174 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:26,174 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34587,1675782200572 2023-02-07 15:03:26,174 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:26,174 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6642d7a7 rejected from java.util.concurrent.ThreadPoolExecutor@627d5fb7[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,174 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:26,174 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@669df6b8 rejected from java.util.concurrent.ThreadPoolExecutor@627d5fb7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,175 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:26,175 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40501,1675782200546 2023-02-07 15:03:26,175 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c96a16c rejected from java.util.concurrent.ThreadPoolExecutor@48a93c26[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,175 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e1a8fb1 rejected from java.util.concurrent.ThreadPoolExecutor@627d5fb7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,176 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40501,1675782200546] 2023-02-07 15:03:26,176 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40501,1675782200546; numProcessing=1 2023-02-07 15:03:26,178 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40501,1675782200546 already deleted, retry=false 2023-02-07 15:03:26,178 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40501,1675782200546 expired; onlineServers=1 2023-02-07 15:03:26,178 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34587,1675782200572] 2023-02-07 15:03:26,178 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34587,1675782200572; numProcessing=2 2023-02-07 15:03:26,179 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34587,1675782200572 already deleted, retry=false 2023-02-07 15:03:26,179 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34587,1675782200572 expired; onlineServers=0 2023-02-07 15:03:26,179 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44799,1675782200497' ***** 2023-02-07 15:03:26,179 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 15:03:26,180 DEBUG [M:0;jenkins-hbase4:44799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fa36f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:26,180 INFO [M:0;jenkins-hbase4:44799] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44799,1675782200497 2023-02-07 15:03:26,180 INFO [M:0;jenkins-hbase4:44799] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44799,1675782200497; all regions closed. 2023-02-07 15:03:26,180 DEBUG [M:0;jenkins-hbase4:44799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:26,180 DEBUG [M:0;jenkins-hbase4:44799] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 15:03:26,180 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 15:03:26,180 DEBUG [M:0;jenkins-hbase4:44799] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 15:03:26,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782200744] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782200744,5,FailOnTimeoutGroup] 2023-02-07 15:03:26,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782200744] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782200744,5,FailOnTimeoutGroup] 2023-02-07 15:03:26,180 INFO [M:0;jenkins-hbase4:44799] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 15:03:26,182 INFO [M:0;jenkins-hbase4:44799] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 15:03:26,182 INFO [M:0;jenkins-hbase4:44799] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 15:03:26,182 DEBUG [M:0;jenkins-hbase4:44799] master.HMaster(1502): Stopping service threads 2023-02-07 15:03:26,182 INFO [M:0;jenkins-hbase4:44799] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 15:03:26,182 ERROR [M:0;jenkins-hbase4:44799] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 15:03:26,183 INFO [M:0;jenkins-hbase4:44799] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 15:03:26,183 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 15:03:26,183 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:26,183 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:26,183 DEBUG [M:0;jenkins-hbase4:44799] zookeeper.ZKUtil(398): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 15:03:26,183 WARN [M:0;jenkins-hbase4:44799] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 15:03:26,183 INFO [M:0;jenkins-hbase4:44799] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 15:03:26,184 INFO [M:0;jenkins-hbase4:44799] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 15:03:26,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:26,184 DEBUG [M:0;jenkins-hbase4:44799] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:26,184 INFO [M:0;jenkins-hbase4:44799] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:26,184 DEBUG [M:0;jenkins-hbase4:44799] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:26,184 DEBUG [M:0;jenkins-hbase4:44799] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:26,184 DEBUG [M:0;jenkins-hbase4:44799] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:26,184 INFO [M:0;jenkins-hbase4:44799] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.13 KB heapSize=200.04 KB 2023-02-07 15:03:26,192 INFO [M:0;jenkins-hbase4:44799] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.13 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd3f564ebd434477a3730d73c522785b 2023-02-07 15:03:26,196 DEBUG [M:0;jenkins-hbase4:44799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd3f564ebd434477a3730d73c522785b as hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd3f564ebd434477a3730d73c522785b 2023-02-07 15:03:26,199 INFO [M:0;jenkins-hbase4:44799] regionserver.HStore(1080): Added hdfs://localhost:35559/user/jenkins/test-data/34791d7d-b0e4-de50-b6ba-31d26357f7a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd3f564ebd434477a3730d73c522785b, entries=53, sequenceid=357, filesize=10.7 K 2023-02-07 15:03:26,200 INFO [M:0;jenkins-hbase4:44799] regionserver.HRegion(2947): Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-07 15:03:26,200 INFO [M:0;jenkins-hbase4:44799] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:26,200 DEBUG [M:0;jenkins-hbase4:44799] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782206184Disabling compacts and flushes for region at 1675782206184Disabling writes for close at 1675782206184Obtaining lock to block concurrent updates at 1675782206184Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675782206184Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171142, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675782206184Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675782206185 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675782206186 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675782206187 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675782206188 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675782206196 (+8 ms)Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1675782206200 (+4 ms)Writing region close event to WAL at 1675782206200Closed at 1675782206200 2023-02-07 15:03:26,203 INFO [M:0;jenkins-hbase4:44799] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 15:03:26,203 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:26,204 INFO [M:0;jenkins-hbase4:44799] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44799 2023-02-07 15:03:26,207 DEBUG [M:0;jenkins-hbase4:44799] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44799,1675782200497 already deleted, retry=false 2023-02-07 15:03:26,459 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:26,459 INFO [M:0;jenkins-hbase4:44799] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44799,1675782200497; zookeeper connection closed. 2023-02-07 15:03:26,459 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27362b75 rejected from java.util.concurrent.ThreadPoolExecutor@2309bb4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,460 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): master:44799-0x1002f4f06610000, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:26,460 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41dc45bc rejected from java.util.concurrent.ThreadPoolExecutor@2309bb4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,559 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:26,559 INFO [RS:0;jenkins-hbase4:40501] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40501,1675782200546; zookeeper connection closed. 2023-02-07 15:03:26,559 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4588b653 rejected from java.util.concurrent.ThreadPoolExecutor@48a93c26[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,559 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:40501-0x1002f4f06610001, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:26,559 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5c5c0722] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5c5c0722 2023-02-07 15:03:26,559 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3da5a1e8 rejected from java.util.concurrent.ThreadPoolExecutor@48a93c26[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,659 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:26,659 INFO [RS:1;jenkins-hbase4:34587] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34587,1675782200572; zookeeper connection closed. 2023-02-07 15:03:26,659 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e7124b7 rejected from java.util.concurrent.ThreadPoolExecutor@627d5fb7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,660 DEBUG [Listener at localhost/42617-EventThread] zookeeper.ZKWatcher(600): regionserver:34587-0x1002f4f06610002, quorum=127.0.0.1:50579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:26,660 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40e7f0db] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40e7f0db 2023-02-07 15:03:26,660 ERROR [Listener at localhost/42617-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51e65f8 rejected from java.util.concurrent.ThreadPoolExecutor@627d5fb7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:26,660 INFO [Listener at localhost/42617] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 15:03:26,661 WARN [Listener at localhost/42617] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:26,664 INFO [Listener at localhost/42617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:26,772 WARN [BP-1526245673-172.31.14.131-1675782199796 heartbeating to localhost/127.0.0.1:35559] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:26,772 WARN [BP-1526245673-172.31.14.131-1675782199796 heartbeating to localhost/127.0.0.1:35559] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1526245673-172.31.14.131-1675782199796 (Datanode Uuid cfb5898d-f79d-4d62-b442-1dcf7c279eb6) service to localhost/127.0.0.1:35559 2023-02-07 15:03:26,775 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e/dfs/data/data3/current/BP-1526245673-172.31.14.131-1675782199796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:26,776 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e/dfs/data/data4/current/BP-1526245673-172.31.14.131-1675782199796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:26,777 WARN [Listener at localhost/42617] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:26,780 INFO [Listener at localhost/42617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:26,886 WARN [BP-1526245673-172.31.14.131-1675782199796 heartbeating to localhost/127.0.0.1:35559] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:26,887 WARN [BP-1526245673-172.31.14.131-1675782199796 heartbeating to localhost/127.0.0.1:35559] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1526245673-172.31.14.131-1675782199796 (Datanode Uuid e0722cb5-6283-4581-aa16-6c2a6db13a51) service to localhost/127.0.0.1:35559 2023-02-07 15:03:26,888 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e/dfs/data/data1/current/BP-1526245673-172.31.14.131-1675782199796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:26,888 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/cluster_54f5ed99-ecd3-0214-318d-ad7df58ebc9e/dfs/data/data2/current/BP-1526245673-172.31.14.131-1675782199796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:26,898 INFO [Listener at localhost/42617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:27,016 INFO [Listener at localhost/42617] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 15:03:27,037 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 15:03:27,059 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 15:03:27,075 INFO [Listener at localhost/42617] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 180) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:35559 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42617 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:35559 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:35559 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:35559 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:35559 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:35559 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44799,1675782200497)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35559 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42617.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=649 (was 567) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 308), ProcessCount=166 (was 166), AvailableMemoryMB=5475 (was 5650) 2023-02-07 15:03:27,086 INFO [Listener at localhost/42617] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=166, AvailableMemoryMB=5474 2023-02-07 15:03:27,099 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/hadoop.log.dir so I do NOT create it in target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a 2023-02-07 15:03:27,099 WARN [Listener at localhost/42617] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 15:03:27,099 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/hadoop.tmp.dir so I do NOT create it in target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a 2023-02-07 15:03:27,099 WARN [Listener at localhost/42617] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/467fd965-f018-7f35-1a85-ee9927faeeb5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 15:03:27,099 DEBUG [Listener at localhost/42617] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e, deleteOnExit=true 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/test.cache.data in system properties and HBase conf 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/hadoop.log.dir in system properties and HBase conf 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 15:03:27,100 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 15:03:27,100 DEBUG [Listener at localhost/42617] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 15:03:27,101 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/nfs.dump.dir in system properties and HBase conf 2023-02-07 15:03:27,102 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/java.io.tmpdir in system properties and HBase conf 2023-02-07 15:03:27,102 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:27,102 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 15:03:27,102 INFO [Listener at localhost/42617] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 15:03:27,106 WARN [Listener at localhost/42617] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:27,106 WARN [Listener at localhost/42617] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:27,141 WARN [Listener at localhost/42617] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:27,143 INFO [Listener at localhost/42617] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:27,150 INFO [Listener at localhost/42617] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/java.io.tmpdir/Jetty_localhost_33721_hdfs____ohf1fk/webapp 2023-02-07 15:03:27,245 INFO [Listener at localhost/42617] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33721 2023-02-07 15:03:27,250 WARN [Listener at localhost/42617] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:27,250 WARN [Listener at localhost/42617] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:27,294 WARN [Listener at localhost/46217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:27,318 WARN [Listener at localhost/46217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:27,320 WARN [Listener at localhost/46217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:27,321 INFO [Listener at localhost/46217] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:27,327 INFO [Listener at localhost/46217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/java.io.tmpdir/Jetty_localhost_39973_datanode____.4ygctm/webapp 2023-02-07 15:03:27,421 INFO [Listener at localhost/46217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39973 2023-02-07 15:03:27,430 WARN [Listener at localhost/33027] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:27,451 WARN [Listener at localhost/33027] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:27,453 WARN [Listener at localhost/33027] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:27,454 INFO [Listener at localhost/33027] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:27,457 INFO [Listener at localhost/33027] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/java.io.tmpdir/Jetty_localhost_36453_datanode____.gj9bt6/webapp 2023-02-07 15:03:27,542 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18a7a761361f93d1: Processing first storage report for DS-da31ae8f-1794-448a-9ab3-a01d862d3d59 from datanode 60730337-f96e-42b6-94a4-ba61548a6a77 2023-02-07 15:03:27,542 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18a7a761361f93d1: from storage DS-da31ae8f-1794-448a-9ab3-a01d862d3d59 node DatanodeRegistration(127.0.0.1:46271, datanodeUuid=60730337-f96e-42b6-94a4-ba61548a6a77, infoPort=39767, infoSecurePort=0, ipcPort=33027, storageInfo=lv=-57;cid=testClusterID;nsid=1128769380;c=1675782207108), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:27,542 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18a7a761361f93d1: Processing first storage report for DS-e93ea784-df0f-4fcb-b326-eac4c3b27f92 from datanode 60730337-f96e-42b6-94a4-ba61548a6a77 2023-02-07 15:03:27,542 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18a7a761361f93d1: from storage DS-e93ea784-df0f-4fcb-b326-eac4c3b27f92 node DatanodeRegistration(127.0.0.1:46271, datanodeUuid=60730337-f96e-42b6-94a4-ba61548a6a77, infoPort=39767, infoSecurePort=0, ipcPort=33027, storageInfo=lv=-57;cid=testClusterID;nsid=1128769380;c=1675782207108), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:27,571 INFO [Listener at localhost/33027] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36453 2023-02-07 15:03:27,580 WARN [Listener at localhost/42341] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:27,665 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c10de263b286c35: Processing first storage report for DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4 from datanode 58152bc9-b714-4d36-8500-15ac8909fd43 2023-02-07 15:03:27,665 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c10de263b286c35: from storage DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4 node DatanodeRegistration(127.0.0.1:40895, datanodeUuid=58152bc9-b714-4d36-8500-15ac8909fd43, infoPort=33587, infoSecurePort=0, ipcPort=42341, storageInfo=lv=-57;cid=testClusterID;nsid=1128769380;c=1675782207108), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:27,665 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c10de263b286c35: Processing first storage report for DS-145020e9-aabe-4713-8e10-70a0f6f17ffd from datanode 58152bc9-b714-4d36-8500-15ac8909fd43 2023-02-07 15:03:27,665 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c10de263b286c35: from storage DS-145020e9-aabe-4713-8e10-70a0f6f17ffd node DatanodeRegistration(127.0.0.1:40895, datanodeUuid=58152bc9-b714-4d36-8500-15ac8909fd43, infoPort=33587, infoSecurePort=0, ipcPort=42341, storageInfo=lv=-57;cid=testClusterID;nsid=1128769380;c=1675782207108), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:27,686 DEBUG [Listener at localhost/42341] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a 2023-02-07 15:03:27,689 INFO [Listener at localhost/42341] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e/zookeeper_0, clientPort=61362, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 15:03:27,690 INFO [Listener at localhost/42341] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61362 2023-02-07 15:03:27,691 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,691 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,704 INFO [Listener at localhost/42341] util.FSUtils(479): Created version file at hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca with version=8 2023-02-07 15:03:27,704 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,705 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,706 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/hbase-staging 2023-02-07 15:03:27,707 INFO [Listener at localhost/42341] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:27,708 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,708 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,708 INFO [Listener at localhost/42341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:27,708 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,708 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:27,708 INFO [Listener at localhost/42341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:27,709 INFO [Listener at localhost/42341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42263 2023-02-07 15:03:27,709 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,711 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,712 INFO [Listener at localhost/42341] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42263 connecting to ZooKeeper ensemble=127.0.0.1:61362 2023-02-07 15:03:27,719 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:422630x0, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:27,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42263-0x1002f4f228d0000 connected 2023-02-07 15:03:27,738 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:27,739 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:27,739 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:27,740 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42263 2023-02-07 15:03:27,741 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42263 2023-02-07 15:03:27,741 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42263 2023-02-07 15:03:27,741 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42263 2023-02-07 15:03:27,741 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42263 2023-02-07 15:03:27,742 INFO [Listener at localhost/42341] master.HMaster(439): hbase.rootdir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca, hbase.cluster.distributed=false 2023-02-07 15:03:27,753 INFO [Listener at localhost/42341] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:27,754 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,754 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,754 INFO [Listener at localhost/42341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:27,754 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,754 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:27,754 INFO [Listener at localhost/42341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:27,755 INFO [Listener at localhost/42341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40895 2023-02-07 15:03:27,755 INFO [Listener at localhost/42341] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:27,760 DEBUG [Listener at localhost/42341] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:27,760 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,761 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,762 INFO [Listener at localhost/42341] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40895 connecting to ZooKeeper ensemble=127.0.0.1:61362 2023-02-07 15:03:27,766 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:408950x0, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:27,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40895-0x1002f4f228d0001 connected 2023-02-07 15:03:27,768 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:27,768 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:27,769 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:27,769 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40895 2023-02-07 15:03:27,769 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40895 2023-02-07 15:03:27,772 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40895 2023-02-07 15:03:27,776 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40895 2023-02-07 15:03:27,776 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40895 2023-02-07 15:03:27,787 INFO [Listener at localhost/42341] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:27,787 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,787 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,787 INFO [Listener at localhost/42341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:27,787 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:27,787 INFO [Listener at localhost/42341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:27,787 INFO [Listener at localhost/42341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:27,788 INFO [Listener at localhost/42341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44487 2023-02-07 15:03:27,788 INFO [Listener at localhost/42341] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:27,789 DEBUG [Listener at localhost/42341] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:27,789 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,790 INFO [Listener at localhost/42341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,790 INFO [Listener at localhost/42341] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44487 connecting to ZooKeeper ensemble=127.0.0.1:61362 2023-02-07 15:03:27,793 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:444870x0, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:27,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44487-0x1002f4f228d0002 connected 2023-02-07 15:03:27,795 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:27,795 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:27,796 DEBUG [Listener at localhost/42341] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:27,800 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44487 2023-02-07 15:03:27,800 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44487 2023-02-07 15:03:27,800 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44487 2023-02-07 15:03:27,801 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44487 2023-02-07 15:03:27,801 DEBUG [Listener at localhost/42341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44487 2023-02-07 15:03:27,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:27,803 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:27,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:27,805 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:27,805 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:27,805 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:27,805 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:27,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:27,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42263,1675782207707 from backup master directory 2023-02-07 15:03:27,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:27,810 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:27,810 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:27,810 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:27,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:27,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/hbase.id with ID: 53e17925-a770-41d3-ba7e-dcb1f688cf75 2023-02-07 15:03:27,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:27,831 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:27,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0c719fb4 to 127.0.0.1:61362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:27,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e9dbd23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:27,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:27,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 15:03:27,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:27,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store-tmp 2023-02-07 15:03:27,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:27,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:27,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:27,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:27,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:27,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:27,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:27,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782207850Disabling compacts and flushes for region at 1675782207850Disabling writes for close at 1675782207850Writing region close event to WAL at 1675782207850Closed at 1675782207850 2023-02-07 15:03:27,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/WALs/jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:27,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42263%2C1675782207707, suffix=, logDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/WALs/jenkins-hbase4.apache.org,42263,1675782207707, archiveDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/oldWALs, maxLogs=10 2023-02-07 15:03:27,866 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK] 2023-02-07 15:03:27,867 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK] 2023-02-07 15:03:27,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/WALs/jenkins-hbase4.apache.org,42263,1675782207707/jenkins-hbase4.apache.org%2C42263%2C1675782207707.1675782207853 2023-02-07 15:03:27,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK], DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK]] 2023-02-07 15:03:27,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:27,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:27,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:27,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:27,870 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:27,871 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 15:03:27,871 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 15:03:27,871 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:27,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:27,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:27,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68040287, jitterRate=0.013879284262657166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:27,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675782207869Initializing all the Stores at 1675782207869Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782207869Cleaning up temporary data from old regions at 1675782207872 (+3 ms)Cleaning up detritus from prior splits at 1675782207873 (+1 ms)Region opened successfully at 1675782207875 (+2 ms) 2023-02-07 15:03:27,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 15:03:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 15:03:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 15:03:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 15:03:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 15:03:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 15:03:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 15:03:27,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 15:03:27,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 15:03:27,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 15:03:27,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 15:03:27,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 15:03:27,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 15:03:27,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 15:03:27,892 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:27,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 15:03:27,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 15:03:27,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 15:03:27,898 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:27,898 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:27,899 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:27,899 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:27,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42263,1675782207707, sessionid=0x1002f4f228d0000, setting cluster-up flag (Was=false) 2023-02-07 15:03:27,903 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:27,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 15:03:27,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:27,910 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:27,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 15:03:27,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:27,916 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.hbase-snapshot/.tmp 2023-02-07 15:03:27,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:27,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:27,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:27,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:27,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:27,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 15:03:27,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:27,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:27,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:27,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675782237919 2023-02-07 15:03:27,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 15:03:27,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 15:03:27,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 15:03:27,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 15:03:27,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 15:03:27,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 15:03:27,920 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:27,920 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 15:03:27,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:27,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 15:03:27,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782207921,5,FailOnTimeoutGroup] 2023-02-07 15:03:27,921 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:27,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782207921,5,FailOnTimeoutGroup] 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:27,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:27,935 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:27,935 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:27,935 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca 2023-02-07 15:03:27,942 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:27,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:27,944 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/info 2023-02-07 15:03:27,945 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:27,945 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:27,945 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:27,946 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:27,946 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:27,947 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:27,947 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:27,948 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/table 2023-02-07 15:03:27,948 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:27,948 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:27,949 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740 2023-02-07 15:03:27,949 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740 2023-02-07 15:03:27,951 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:27,952 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:27,953 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:27,953 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65691918, jitterRate=-0.02111414074897766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:27,954 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675782207942Initializing all the Stores at 1675782207943 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782207943Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782207943Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782207943Cleaning up temporary data from old regions at 1675782207950 (+7 ms)Cleaning up detritus from prior splits at 1675782207950Region opened successfully at 1675782207953 (+3 ms) 2023-02-07 15:03:27,954 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:27,954 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:27,954 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:27,954 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:27,954 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:27,954 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:27,954 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782207954Disabling compacts and flushes for region at 1675782207954Disabling writes for close at 1675782207954Writing region close event to WAL at 1675782207954Closed at 1675782207954 2023-02-07 15:03:27,955 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:27,955 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 15:03:27,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 15:03:27,957 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 15:03:27,958 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 15:03:28,003 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(952): ClusterId : 53e17925-a770-41d3-ba7e-dcb1f688cf75 2023-02-07 15:03:28,003 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(952): ClusterId : 53e17925-a770-41d3-ba7e-dcb1f688cf75 2023-02-07 15:03:28,004 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:28,004 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:28,005 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:28,006 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:28,005 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:28,006 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:28,009 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:28,010 DEBUG [RS:0;jenkins-hbase4:40895] zookeeper.ReadOnlyZKClient(139): Connect 0x272d41b0 to 127.0.0.1:61362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:28,010 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:28,012 DEBUG [RS:1;jenkins-hbase4:44487] zookeeper.ReadOnlyZKClient(139): Connect 0x43ef0bbc to 127.0.0.1:61362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:28,023 DEBUG [RS:0;jenkins-hbase4:40895] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29eabb25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:28,024 DEBUG [RS:0;jenkins-hbase4:40895] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dd52ac0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:28,024 DEBUG [RS:1;jenkins-hbase4:44487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d28fdb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:28,024 DEBUG [RS:1;jenkins-hbase4:44487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@491760cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:28,032 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40895 2023-02-07 15:03:28,032 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44487 2023-02-07 15:03:28,032 INFO [RS:0;jenkins-hbase4:40895] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:28,032 INFO [RS:0;jenkins-hbase4:40895] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:28,032 INFO [RS:1;jenkins-hbase4:44487] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:28,032 INFO [RS:1;jenkins-hbase4:44487] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:28,032 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:28,032 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:28,033 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42263,1675782207707 with isa=jenkins-hbase4.apache.org/172.31.14.131:40895, startcode=1675782207753 2023-02-07 15:03:28,033 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42263,1675782207707 with isa=jenkins-hbase4.apache.org/172.31.14.131:44487, startcode=1675782207786 2023-02-07 15:03:28,034 DEBUG [RS:0;jenkins-hbase4:40895] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:28,034 DEBUG [RS:1;jenkins-hbase4:44487] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:28,037 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40847, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:28,037 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41115, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:28,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42263] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,039 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca 2023-02-07 15:03:28,039 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca 2023-02-07 15:03:28,039 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46217 2023-02-07 15:03:28,039 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46217 2023-02-07 15:03:28,039 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:28,039 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:28,044 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:28,044 DEBUG [RS:1;jenkins-hbase4:44487] zookeeper.ZKUtil(162): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,044 DEBUG [RS:0;jenkins-hbase4:40895] zookeeper.ZKUtil(162): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,045 WARN [RS:1;jenkins-hbase4:44487] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:28,045 WARN [RS:0;jenkins-hbase4:40895] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:28,045 INFO [RS:1;jenkins-hbase4:44487] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:28,045 INFO [RS:0;jenkins-hbase4:40895] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:28,045 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,045 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,045 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40895,1675782207753] 2023-02-07 15:03:28,045 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44487,1675782207786] 2023-02-07 15:03:28,051 DEBUG [RS:1;jenkins-hbase4:44487] zookeeper.ZKUtil(162): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,051 DEBUG [RS:0;jenkins-hbase4:40895] zookeeper.ZKUtil(162): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,051 DEBUG [RS:1;jenkins-hbase4:44487] zookeeper.ZKUtil(162): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,051 DEBUG [RS:0;jenkins-hbase4:40895] zookeeper.ZKUtil(162): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,052 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:28,052 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:28,052 INFO [RS:1;jenkins-hbase4:44487] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:28,052 INFO [RS:0;jenkins-hbase4:40895] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:28,053 INFO [RS:1;jenkins-hbase4:44487] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:28,053 INFO [RS:1;jenkins-hbase4:44487] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:28,053 INFO [RS:1;jenkins-hbase4:44487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,053 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:28,054 INFO [RS:0;jenkins-hbase4:40895] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:28,055 INFO [RS:0;jenkins-hbase4:40895] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:28,055 INFO [RS:1;jenkins-hbase4:44487] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,055 INFO [RS:0;jenkins-hbase4:40895] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,055 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,055 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,055 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:28,055 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,055 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,055 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,055 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:28,056 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,056 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,056 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,056 DEBUG [RS:1;jenkins-hbase4:44487] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,059 INFO [RS:0;jenkins-hbase4:40895] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,059 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,059 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,059 INFO [RS:1;jenkins-hbase4:44487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,059 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,059 INFO [RS:1;jenkins-hbase4:44487] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,059 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,060 INFO [RS:1;jenkins-hbase4:44487] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,060 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,060 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:28,060 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,060 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,060 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,060 DEBUG [RS:0;jenkins-hbase4:40895] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:28,062 INFO [RS:0;jenkins-hbase4:40895] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,062 INFO [RS:0;jenkins-hbase4:40895] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,062 INFO [RS:0;jenkins-hbase4:40895] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,075 INFO [RS:1;jenkins-hbase4:44487] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:28,075 INFO [RS:1;jenkins-hbase4:44487] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44487,1675782207786-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,077 INFO [RS:0;jenkins-hbase4:40895] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:28,077 INFO [RS:0;jenkins-hbase4:40895] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40895,1675782207753-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,090 INFO [RS:1;jenkins-hbase4:44487] regionserver.Replication(203): jenkins-hbase4.apache.org,44487,1675782207786 started 2023-02-07 15:03:28,090 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44487,1675782207786, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44487, sessionid=0x1002f4f228d0002 2023-02-07 15:03:28,090 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:28,090 DEBUG [RS:1;jenkins-hbase4:44487] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,090 DEBUG [RS:1;jenkins-hbase4:44487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44487,1675782207786' 2023-02-07 15:03:28,090 DEBUG [RS:1;jenkins-hbase4:44487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:28,090 DEBUG [RS:1;jenkins-hbase4:44487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:28,090 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:28,091 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:28,091 DEBUG [RS:1;jenkins-hbase4:44487] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,091 DEBUG [RS:1;jenkins-hbase4:44487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44487,1675782207786' 2023-02-07 15:03:28,091 DEBUG [RS:1;jenkins-hbase4:44487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:28,091 DEBUG [RS:1;jenkins-hbase4:44487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:28,091 DEBUG [RS:1;jenkins-hbase4:44487] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:28,091 INFO [RS:1;jenkins-hbase4:44487] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:28,091 INFO [RS:1;jenkins-hbase4:44487] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:28,092 INFO [RS:0;jenkins-hbase4:40895] regionserver.Replication(203): jenkins-hbase4.apache.org,40895,1675782207753 started 2023-02-07 15:03:28,092 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40895,1675782207753, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40895, sessionid=0x1002f4f228d0001 2023-02-07 15:03:28,092 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:28,092 DEBUG [RS:0;jenkins-hbase4:40895] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40895,1675782207753' 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40895,1675782207753' 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:28,093 DEBUG [RS:0;jenkins-hbase4:40895] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:28,094 DEBUG [RS:0;jenkins-hbase4:40895] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:28,094 INFO [RS:0;jenkins-hbase4:40895] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:28,094 INFO [RS:0;jenkins-hbase4:40895] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:28,109 DEBUG [jenkins-hbase4:42263] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 15:03:28,109 DEBUG [jenkins-hbase4:42263] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:28,110 DEBUG [jenkins-hbase4:42263] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:28,110 DEBUG [jenkins-hbase4:42263] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:28,110 DEBUG [jenkins-hbase4:42263] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:28,110 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40895,1675782207753, state=OPENING 2023-02-07 15:03:28,112 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 15:03:28,113 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:28,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40895,1675782207753}] 2023-02-07 15:03:28,117 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:28,270 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:28,270 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:28,272 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48552, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:28,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 15:03:28,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:28,277 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40895%2C1675782207753.meta, suffix=.meta, logDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,40895,1675782207753, archiveDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/oldWALs, maxLogs=32 2023-02-07 15:03:28,292 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK] 2023-02-07 15:03:28,292 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK] 2023-02-07 15:03:28,294 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,40895,1675782207753/jenkins-hbase4.apache.org%2C40895%2C1675782207753.meta.1675782208277.meta 2023-02-07 15:03:28,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK], DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK]] 2023-02-07 15:03:28,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:28,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 15:03:28,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 15:03:28,294 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 15:03:28,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 15:03:28,295 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:28,295 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 15:03:28,295 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 15:03:28,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:28,296 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/info 2023-02-07 15:03:28,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/info 2023-02-07 15:03:28,297 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:28,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:28,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:28,298 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:28,298 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:28,298 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:28,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:28,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:28,299 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/table 2023-02-07 15:03:28,299 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/table 2023-02-07 15:03:28,299 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:28,300 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:28,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740 2023-02-07 15:03:28,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740 2023-02-07 15:03:28,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:28,303 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:28,304 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74350901, jitterRate=0.1079147607088089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:28,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675782208295Writing region info on filesystem at 1675782208295Initializing all the Stores at 1675782208295Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782208295Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782208296 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782208296Cleaning up temporary data from old regions at 1675782208302 (+6 ms)Cleaning up detritus from prior splits at 1675782208302Running coprocessor post-open hooks at 1675782208304 (+2 ms)Region opened successfully at 1675782208304 2023-02-07 15:03:28,304 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675782208270 2023-02-07 15:03:28,308 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 15:03:28,309 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 15:03:28,309 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40895,1675782207753, state=OPEN 2023-02-07 15:03:28,310 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 15:03:28,310 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:28,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 15:03:28,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40895,1675782207753 in 197 msec 2023-02-07 15:03:28,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 15:03:28,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-07 15:03:28,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 396 msec 2023-02-07 15:03:28,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675782207804, completionTime=-1 2023-02-07 15:03:28,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 15:03:28,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 15:03:28,317 DEBUG [hconnection-0x4f0a8cab-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:28,319 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48568, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:28,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 15:03:28,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675782268320 2023-02-07 15:03:28,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675782328320 2023-02-07 15:03:28,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 15:03:28,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42263,1675782207707-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42263,1675782207707-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42263,1675782207707-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42263, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:28,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 15:03:28,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:28,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 15:03:28,331 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:28,331 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 15:03:28,331 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:28,333 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,333 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991 empty. 2023-02-07 15:03:28,334 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,334 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 15:03:28,346 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:28,347 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7a0456f27adaf1ba2e2609e43e44c991, NAME => 'hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp 2023-02-07 15:03:28,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:28,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7a0456f27adaf1ba2e2609e43e44c991, disabling compactions & flushes 2023-02-07 15:03:28,354 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:28,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:28,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. after waiting 0 ms 2023-02-07 15:03:28,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:28,354 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:28,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7a0456f27adaf1ba2e2609e43e44c991: Waiting for close lock at 1675782208354Disabling compacts and flushes for region at 1675782208354Disabling writes for close at 1675782208354Writing region close event to WAL at 1675782208354Closed at 1675782208354 2023-02-07 15:03:28,356 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:28,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782208356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782208356"}]},"ts":"1675782208356"} 2023-02-07 15:03:28,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:28,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:28,359 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782208359"}]},"ts":"1675782208359"} 2023-02-07 15:03:28,360 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 15:03:28,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:28,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:28,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:28,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:28,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7a0456f27adaf1ba2e2609e43e44c991, ASSIGN}] 2023-02-07 15:03:28,366 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7a0456f27adaf1ba2e2609e43e44c991, ASSIGN 2023-02-07 15:03:28,367 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7a0456f27adaf1ba2e2609e43e44c991, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44487,1675782207786; forceNewPlan=false, retain=false 2023-02-07 15:03:28,517 INFO [jenkins-hbase4:42263] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:28,517 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7a0456f27adaf1ba2e2609e43e44c991, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,517 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782208517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782208517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782208517"}]},"ts":"1675782208517"} 2023-02-07 15:03:28,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7a0456f27adaf1ba2e2609e43e44c991, server=jenkins-hbase4.apache.org,44487,1675782207786}] 2023-02-07 15:03:28,671 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,671 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:28,672 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:28,676 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:28,677 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44487%2C1675782207786, suffix=, logDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,44487,1675782207786, archiveDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/oldWALs, maxLogs=32 2023-02-07 15:03:28,696 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK] 2023-02-07 15:03:28,697 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK] 2023-02-07 15:03:28,698 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,44487,1675782207786/jenkins-hbase4.apache.org%2C44487%2C1675782207786.1675782208678 2023-02-07 15:03:28,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK], DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK]] 2023-02-07 15:03:28,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7a0456f27adaf1ba2e2609e43e44c991, NAME => 'hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:28,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:28,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,700 INFO [StoreOpener-7a0456f27adaf1ba2e2609e43e44c991-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,701 DEBUG [StoreOpener-7a0456f27adaf1ba2e2609e43e44c991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/info 2023-02-07 15:03:28,702 DEBUG [StoreOpener-7a0456f27adaf1ba2e2609e43e44c991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/info 2023-02-07 15:03:28,702 INFO [StoreOpener-7a0456f27adaf1ba2e2609e43e44c991-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a0456f27adaf1ba2e2609e43e44c991 columnFamilyName info 2023-02-07 15:03:28,702 INFO [StoreOpener-7a0456f27adaf1ba2e2609e43e44c991-1] regionserver.HStore(310): Store=7a0456f27adaf1ba2e2609e43e44c991/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:28,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:28,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:28,707 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7a0456f27adaf1ba2e2609e43e44c991; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74135126, jitterRate=0.10469946265220642}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:28,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7a0456f27adaf1ba2e2609e43e44c991: Running coprocessor pre-open hook at 1675782208699Writing region info on filesystem at 1675782208699Initializing all the Stores at 1675782208700 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782208700Cleaning up temporary data from old regions at 1675782208703 (+3 ms)Cleaning up detritus from prior splits at 1675782208704 (+1 ms)Running coprocessor post-open hooks at 1675782208707 (+3 ms)Region opened successfully at 1675782208707 2023-02-07 15:03:28,708 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991., pid=6, masterSystemTime=1675782208671 2023-02-07 15:03:28,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:28,711 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:28,712 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7a0456f27adaf1ba2e2609e43e44c991, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:28,712 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782208712"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782208712"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782208712"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782208712"}]},"ts":"1675782208712"} 2023-02-07 15:03:28,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 15:03:28,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7a0456f27adaf1ba2e2609e43e44c991, server=jenkins-hbase4.apache.org,44487,1675782207786 in 194 msec 2023-02-07 15:03:28,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 15:03:28,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7a0456f27adaf1ba2e2609e43e44c991, ASSIGN in 350 msec 2023-02-07 15:03:28,716 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:28,716 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782208716"}]},"ts":"1675782208716"} 2023-02-07 15:03:28,717 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 15:03:28,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:28,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 391 msec 2023-02-07 15:03:28,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 15:03:28,731 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:28,731 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:28,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:28,734 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33108, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:28,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 15:03:28,744 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:28,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-07 15:03:28,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 15:03:28,755 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:28,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-07 15:03:28,762 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 15:03:28,765 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 15:03:28,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.955sec 2023-02-07 15:03:28,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 15:03:28,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 15:03:28,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 15:03:28,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42263,1675782207707-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 15:03:28,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42263,1675782207707-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 15:03:28,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 15:03:28,804 DEBUG [Listener at localhost/42341] zookeeper.ReadOnlyZKClient(139): Connect 0x446e9cdb to 127.0.0.1:61362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:28,812 DEBUG [Listener at localhost/42341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6474fd1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:28,814 DEBUG [hconnection-0x18ba0636-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:28,815 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:28,817 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:28,817 DEBUG [Listener at localhost/42341] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 15:03:28,817 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:28,817 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:28,822 DEBUG [Listener at localhost/42341] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 15:03:28,824 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33908, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 15:03:28,824 INFO [Listener at localhost/42341] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-07 15:03:28,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-07 15:03:28,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 15:03:28,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:33908 deadline: 1675782268825, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-07 15:03:28,825 INFO [Listener at localhost/42341] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-07 15:03:28,826 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:28,826 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:28,828 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:28,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:28,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:28,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-07 15:03:28,830 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:28,830 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:28,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:28,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:28,832 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:28,832 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5 empty. 2023-02-07 15:03:28,833 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:28,833 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-07 15:03:28,840 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:28,841 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b4f5f4632eba30db65e6ad93d4d540d5, NAME => 'testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp 2023-02-07 15:03:28,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:28,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing b4f5f4632eba30db65e6ad93d4d540d5, disabling compactions & flushes 2023-02-07 15:03:28,847 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:28,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:28,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. after waiting 0 ms 2023-02-07 15:03:28,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:28,847 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:28,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for b4f5f4632eba30db65e6ad93d4d540d5: Waiting for close lock at 1675782208847Disabling compacts and flushes for region at 1675782208847Disabling writes for close at 1675782208847Writing region close event to WAL at 1675782208847Closed at 1675782208847 2023-02-07 15:03:28,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:28,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675782208849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782208849"}]},"ts":"1675782208849"} 2023-02-07 15:03:28,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:28,852 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:28,852 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782208852"}]},"ts":"1675782208852"} 2023-02-07 15:03:28,853 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-07 15:03:28,856 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:28,857 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:28,857 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:28,857 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:28,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4f5f4632eba30db65e6ad93d4d540d5, ASSIGN}] 2023-02-07 15:03:28,859 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4f5f4632eba30db65e6ad93d4d540d5, ASSIGN 2023-02-07 15:03:28,860 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4f5f4632eba30db65e6ad93d4d540d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44487,1675782207786; forceNewPlan=false, retain=false 2023-02-07 15:03:28,932 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:28,932 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:28,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:29,010 INFO [jenkins-hbase4:42263] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:29,011 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b4f5f4632eba30db65e6ad93d4d540d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,011 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675782209011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782209011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782209011"}]},"ts":"1675782209011"} 2023-02-07 15:03:29,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure b4f5f4632eba30db65e6ad93d4d540d5, server=jenkins-hbase4.apache.org,44487,1675782207786}] 2023-02-07 15:03:29,095 INFO [RS:0;jenkins-hbase4:40895] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40895%2C1675782207753, suffix=, logDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,40895,1675782207753, archiveDir=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/oldWALs, maxLogs=32 2023-02-07 15:03:29,107 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK] 2023-02-07 15:03:29,107 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK] 2023-02-07 15:03:29,109 INFO [RS:0;jenkins-hbase4:40895] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,40895,1675782207753/jenkins-hbase4.apache.org%2C40895%2C1675782207753.1675782209096 2023-02-07 15:03:29,109 DEBUG [RS:0;jenkins-hbase4:40895] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46271,DS-da31ae8f-1794-448a-9ab3-a01d862d3d59,DISK], DatanodeInfoWithStorage[127.0.0.1:40895,DS-e10a5ab9-91bc-4e23-8715-b3d3733720d4,DISK]] 2023-02-07 15:03:29,133 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:29,133 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:29,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:29,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:29,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b4f5f4632eba30db65e6ad93d4d540d5, NAME => 'testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:29,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:29,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,170 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,171 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1 2023-02-07 15:03:29,171 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1 2023-02-07 15:03:29,171 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4f5f4632eba30db65e6ad93d4d540d5 columnFamilyName f1 2023-02-07 15:03:29,172 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(310): Store=b4f5f4632eba30db65e6ad93d4d540d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:29,172 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,173 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2 2023-02-07 15:03:29,173 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2 2023-02-07 15:03:29,173 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4f5f4632eba30db65e6ad93d4d540d5 columnFamilyName f2 2023-02-07 15:03:29,173 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(310): Store=b4f5f4632eba30db65e6ad93d4d540d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:29,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:29,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:29,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:29,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b4f5f4632eba30db65e6ad93d4d540d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66454759, jitterRate=-0.009746924042701721}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:29,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b4f5f4632eba30db65e6ad93d4d540d5: Running coprocessor pre-open hook at 1675782209169Writing region info on filesystem at 1675782209169Initializing all the Stores at 1675782209170 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782209170Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782209170Cleaning up temporary data from old regions at 1675782209175 (+5 ms)Cleaning up detritus from prior splits at 1675782209175Running coprocessor post-open hooks at 1675782209178 (+3 ms)Region opened successfully at 1675782209178 2023-02-07 15:03:29,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5., pid=12, masterSystemTime=1675782209166 2023-02-07 15:03:29,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:29,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:29,180 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b4f5f4632eba30db65e6ad93d4d540d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,180 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675782209180"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782209180"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782209180"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782209180"}]},"ts":"1675782209180"} 2023-02-07 15:03:29,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 15:03:29,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure b4f5f4632eba30db65e6ad93d4d540d5, server=jenkins-hbase4.apache.org,44487,1675782207786 in 168 msec 2023-02-07 15:03:29,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 15:03:29,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4f5f4632eba30db65e6ad93d4d540d5, ASSIGN in 326 msec 2023-02-07 15:03:29,185 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:29,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782209185"}]},"ts":"1675782209185"} 2023-02-07 15:03:29,186 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-07 15:03:29,188 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:29,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 360 msec 2023-02-07 15:03:29,435 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:29,435 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:29,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:29,436 INFO [Listener at localhost/42341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-07 15:03:29,437 DEBUG [Listener at localhost/42341] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-07 15:03:29,437 INFO [Listener at localhost/42341] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:29,441 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-07 15:03:29,441 INFO [Listener at localhost/42341] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:29,441 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-07 15:03:29,441 INFO [Listener at localhost/42341] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 15:03:29,497 DEBUG [hconnection-0x18ba0636-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:29,515 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:29,523 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44487] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:29,622 INFO [Listener at localhost/42341] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 15:03:29,622 INFO [Listener at localhost/42341] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 15:03:29,622 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:29,622 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:29,623 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 15:03:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675782209623 (current time:1675782209623). 2023-02-07 15:03:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 15:03:29,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] zookeeper.ReadOnlyZKClient(139): Connect 0x0ceb91f1 to 127.0.0.1:61362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:29,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20dfe21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:29,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:29,629 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48580, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:29,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ceb91f1 to 127.0.0.1:61362 2023-02-07 15:03:29,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:29,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 15:03:29,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 15:03:29,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 15:03:29,633 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 15:03:29,634 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675782809634 2023-02-07 15:03:29,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 15:03:29,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,635 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:29,635 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 15:03:29,636 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 15:03:29,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 15:03:29,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-07 15:03:29,637 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 15:03:29,638 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675782809638 2023-02-07 15:03:29,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,645 INFO [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-07 15:03:29,645 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:29,646 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-07 15:03:29,646 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 15:03:29,646 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,646 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,648 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:29,648 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:29,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:29,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:29,648 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,648 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,649 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,650 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-07 15:03:29,650 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:29,650 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-07 15:03:29,650 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:29,650 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 15:03:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 15:03:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 15:03:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 15:03:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44487,1675782207786' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 15:03:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40895,1675782207753' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 15:03:29,652 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,652 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:29,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:29,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:29,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:29,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44487,1675782207786' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-07 15:03:29,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b7f4b52[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:29,655 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 15:03:29,655 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,656 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,656 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 15:03:29,656 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,656 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 15:03:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 15:03:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40895,1675782207753' in zk 2023-02-07 15:03:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 15:03:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:29,656 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:29,656 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. started... 2023-02-07 15:03:29,656 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b4f5f4632eba30db65e6ad93d4d540d5 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 15:03:29,658 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 15:03:29,658 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:29,658 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 15:03:29,669 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f1/a18d3c45f82a492997c015ab4d48269b 2023-02-07 15:03:29,685 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f2/f6d9c0076db74742b57292df5bbde54c 2023-02-07 15:03:29,689 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f1/a18d3c45f82a492997c015ab4d48269b as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/a18d3c45f82a492997c015ab4d48269b 2023-02-07 15:03:29,692 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/a18d3c45f82a492997c015ab4d48269b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:29,693 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f2/f6d9c0076db74742b57292df5bbde54c as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/f6d9c0076db74742b57292df5bbde54c 2023-02-07 15:03:29,697 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/f6d9c0076db74742b57292df5bbde54c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:29,697 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for b4f5f4632eba30db65e6ad93d4d540d5 in 41ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b4f5f4632eba30db65e6ad93d4d540d5: 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/a18d3c45f82a492997c015ab4d48269b] hfiles 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/a18d3c45f82a492997c015ab4d48269b for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/f6d9c0076db74742b57292df5bbde54c] hfiles 2023-02-07 15:03:29,698 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/f6d9c0076db74742b57292df5bbde54c for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,704 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. completed. 2023-02-07 15:03:29,704 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 15:03:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 15:03:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 15:03:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44487,1675782207786' in zk 2023-02-07 15:03:29,705 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 15:03:29,705 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,705 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,705 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 15:03:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,44487,1675782207786': 2023-02-07 15:03:29,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44487,1675782207786' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 15:03:29,708 INFO [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-07 15:03:29,708 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:29,708 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:29,708 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,708 INFO [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 15:03:29,710 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:29,710 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:29,710 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:29,710 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:29,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:29,711 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,712 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,712 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:29,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:29,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:29,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:29,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:29,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:29,720 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:29,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:29,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:29,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:29,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,736 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:29,736 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:29,736 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:29,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-07 15:03:29,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:29,738 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 15:03:29,753 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-07 15:03:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,753 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675782209634Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675782209720 (+86 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675782209720Writing data manifest for testWithMockedMapReduceSingleRegion at 1675782209723 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675782209728 (+5 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675782209753 (+25 ms) 2023-02-07 15:03:29,755 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 15:03:29,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 120 msec 2023-02-07 15:03:29,938 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:29,938 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:29,938 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:29,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-07 15:03:29,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 15:03:29,940 INFO [Listener at localhost/42341] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 15:03:29,940 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:29,940 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:29,943 INFO [Listener at localhost/42341] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 15:03:29,948 INFO [Listener at localhost/42341] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 15:03:29,985 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44487] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,069 INFO [Listener at localhost/42341] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 15:03:30,072 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,072 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 15:03:30,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,076 INFO [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-07 15:03:30,076 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:30,076 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-07 15:03:30,077 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 15:03:30,077 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,077 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,078 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:30,078 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:30,078 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,079 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,079 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,084 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-07 15:03:30,084 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:30,086 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 15:03:30,086 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-07 15:03:30,086 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:30,086 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 15:03:30,087 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 15:03:30,087 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:30,087 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 15:03:30,087 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,087 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40895,1675782207753' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 15:03:30,087 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. started... 2023-02-07 15:03:30,087 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b4f5f4632eba30db65e6ad93d4d540d5 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 15:03:30,089 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,089 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,089 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:30,101 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f1/d5f2448c224c4b598ca2b419e67abe61 2023-02-07 15:03:30,119 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f2/5ece7e1efbfd452abf4fa3169db7b17f 2023-02-07 15:03:30,123 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f1/d5f2448c224c4b598ca2b419e67abe61 as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/d5f2448c224c4b598ca2b419e67abe61 2023-02-07 15:03:30,128 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/d5f2448c224c4b598ca2b419e67abe61, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:30,129 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/.tmp/f2/5ece7e1efbfd452abf4fa3169db7b17f as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/5ece7e1efbfd452abf4fa3169db7b17f 2023-02-07 15:03:30,134 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/5ece7e1efbfd452abf4fa3169db7b17f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:30,135 INFO [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for b4f5f4632eba30db65e6ad93d4d540d5 in 48ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:30,136 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b4f5f4632eba30db65e6ad93d4d540d5: 2023-02-07 15:03:30,136 DEBUG [rs(jenkins-hbase4.apache.org,44487,1675782207786)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 15:03:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 15:03:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 15:03:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44487,1675782207786' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 15:03:30,139 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,139 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:30,139 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,139 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:30,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44487,1675782207786' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-07 15:03:30,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f40d8e5[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:30,141 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 15:03:30,141 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,142 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,142 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,143 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,143 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 15:03:30,143 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 15:03:30,143 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 15:03:30,143 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 15:03:30,143 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44487,1675782207786' in zk 2023-02-07 15:03:30,143 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40895,1675782207753' in zk 2023-02-07 15:03:30,143 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:30,144 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 15:03:30,144 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:30,144 DEBUG [member: 'jenkins-hbase4.apache.org,40895,1675782207753' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 15:03:30,145 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,145 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 15:03:30,145 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:30,145 DEBUG [member: 'jenkins-hbase4.apache.org,44487,1675782207786' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 15:03:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:30,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,44487,1675782207786': 2023-02-07 15:03:30,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44487,1675782207786' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 15:03:30,148 INFO [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-07 15:03:30,148 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:30,148 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:30,148 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,148 INFO [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 15:03:30,150 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,150 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,150 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:30,150 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:30,151 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:30,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:30,151 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:30,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,151 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,153 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:30,153 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:30,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-07 15:03:30,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:30,155 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,155 DEBUG [(jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:30,156 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,156 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,156 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,156 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,156 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:30,156 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 15:03:30,156 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:30,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:30,256 DEBUG [Listener at localhost/42341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 15:03:30,256 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,256 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 15:03:30,262 INFO [Listener at localhost/42341] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675782209623 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:30,262 DEBUG [Listener at localhost/42341] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736/data/default/testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,262 INFO [Listener at localhost/42341] snapshot.RestoreSnapshotHelper(239): region to add: b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:30,263 INFO [Listener at localhost/42341] snapshot.RestoreSnapshotHelper(585): clone region=b4f5f4632eba30db65e6ad93d4d540d5 as b4f5f4632eba30db65e6ad93d4d540d5 in snapshot testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,264 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b4f5f4632eba30db65e6ad93d4d540d5, NAME => 'testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736 2023-02-07 15:03:30,270 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:30,270 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a18d3c45f82a492997c015ab4d48269b from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,272 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f6d9c0076db74742b57292df5bbde54c from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,273 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b4f5f4632eba30db65e6ad93d4d540d5, disabling compactions & flushes 2023-02-07 15:03:30,273 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,273 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,273 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. after waiting 0 ms 2023-02-07 15:03:30,273 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,273 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,274 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b4f5f4632eba30db65e6ad93d4d540d5: Waiting for close lock at 1675782210273Disabling compacts and flushes for region at 1675782210273Disabling writes for close at 1675782210273Writing region close event to WAL at 1675782210273Closed at 1675782210273 2023-02-07 15:03:30,274 INFO [Listener at localhost/42341] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675782209623 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:30,274 DEBUG [Listener at localhost/42341] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736 2023-02-07 15:03:30,274 DEBUG [Listener at localhost/42341] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736 2023-02-07 15:03:30,274 DEBUG [Listener at localhost/42341] util.CommonFSUtils(699): |-data/ 2023-02-07 15:03:30,275 DEBUG [Listener at localhost/42341] util.CommonFSUtils(699): |----default/ 2023-02-07 15:03:30,275 DEBUG [Listener at localhost/42341] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-07 15:03:30,275 DEBUG [Listener at localhost/42341] util.CommonFSUtils(699): |----------b4f5f4632eba30db65e6ad93d4d540d5/ 2023-02-07 15:03:30,275 DEBUG [Listener at localhost/42341] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:30,276 DEBUG [Listener at localhost/42341] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:30,276 DEBUG [Listener at localhost/42341] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=b4f5f4632eba30db65e6ad93d4d540d5-a18d3c45f82a492997c015ab4d48269b 2023-02-07 15:03:30,276 DEBUG [Listener at localhost/42341] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:30,276 DEBUG [Listener at localhost/42341] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=b4f5f4632eba30db65e6ad93d4d540d5-f6d9c0076db74742b57292df5bbde54c 2023-02-07 15:03:30,279 INFO [Listener at localhost/42341] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 15:03:30,282 DEBUG [Listener at localhost/42341] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:30,282 INFO [Listener at localhost/42341] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:30,282 DEBUG [Listener at localhost/42341] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:30,285 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:30,286 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1 2023-02-07 15:03:30,286 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4f5f4632eba30db65e6ad93d4d540d5 columnFamilyName f1 2023-02-07 15:03:30,290 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(539): loaded hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/testWithMockedMapReduceSingleRegion=b4f5f4632eba30db65e6ad93d4d540d5-a18d3c45f82a492997c015ab4d48269b 2023-02-07 15:03:30,290 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(310): Store=b4f5f4632eba30db65e6ad93d4d540d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:30,290 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:30,291 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2 2023-02-07 15:03:30,291 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4f5f4632eba30db65e6ad93d4d540d5 columnFamilyName f2 2023-02-07 15:03:30,294 DEBUG [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(539): loaded hdfs://localhost:46217/user/jenkins/test-data/1d425575-1620-79bc-d40f-8e2bcb121b69/testWithMockedMapReduceSingleRegion/f02b24ab-2086-4699-9658-ca11ec070736/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/testWithMockedMapReduceSingleRegion=b4f5f4632eba30db65e6ad93d4d540d5-f6d9c0076db74742b57292df5bbde54c 2023-02-07 15:03:30,295 INFO [StoreOpener-b4f5f4632eba30db65e6ad93d4d540d5-1] regionserver.HStore(310): Store=b4f5f4632eba30db65e6ad93d4d540d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:30,295 DEBUG [Listener at localhost/42341] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:30,295 INFO [Listener at localhost/42341] regionserver.HRegion(1071): Opened b4f5f4632eba30db65e6ad93d4d540d5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64328874, jitterRate=-0.041425079107284546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:30,295 DEBUG [Listener at localhost/42341] regionserver.HRegion(964): Region open journal for b4f5f4632eba30db65e6ad93d4d540d5: Writing region info on filesystem at 1675782210283Initializing all the Stores at 1675782210284 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782210284Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782210284Region opened successfully at 1675782210295 (+11 ms) 2023-02-07 15:03:30,340 DEBUG [Listener at localhost/42341] regionserver.HRegion(1603): Closing b4f5f4632eba30db65e6ad93d4d540d5, disabling compactions & flushes 2023-02-07 15:03:30,340 INFO [Listener at localhost/42341] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,340 DEBUG [Listener at localhost/42341] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,340 DEBUG [Listener at localhost/42341] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. after waiting 0 ms 2023-02-07 15:03:30,340 DEBUG [Listener at localhost/42341] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,341 INFO [Listener at localhost/42341] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,341 DEBUG [Listener at localhost/42341] regionserver.HRegion(1557): Region close journal for b4f5f4632eba30db65e6ad93d4d540d5: Waiting for close lock at 1675782210340Disabling compacts and flushes for region at 1675782210340Disabling writes for close at 1675782210340Writing region close event to WAL at 1675782210341 (+1 ms)Closed at 1675782210341 2023-02-07 15:03:30,344 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,344 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-07 15:03:30,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,348 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,348 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,348 INFO [Listener at localhost/42341] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,349 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,351 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,351 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,352 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782210352"}]},"ts":"1675782210352"} 2023-02-07 15:03:30,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:30,353 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-07 15:03:30,354 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-07 15:03:30,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4f5f4632eba30db65e6ad93d4d540d5, UNASSIGN}] 2023-02-07 15:03:30,356 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4f5f4632eba30db65e6ad93d4d540d5, UNASSIGN 2023-02-07 15:03:30,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b4f5f4632eba30db65e6ad93d4d540d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,357 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675782210357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782210357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782210357"}]},"ts":"1675782210357"} 2023-02-07 15:03:30,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure b4f5f4632eba30db65e6ad93d4d540d5, server=jenkins-hbase4.apache.org,44487,1675782207786}] 2023-02-07 15:03:30,452 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,452 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:30,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:30,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b4f5f4632eba30db65e6ad93d4d540d5, disabling compactions & flushes 2023-02-07 15:03:30,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. after waiting 0 ms 2023-02-07 15:03:30,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:30,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5. 2023-02-07 15:03:30,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b4f5f4632eba30db65e6ad93d4d540d5: Waiting for close lock at 1675782210510Running coprocessor pre-close hooks at 1675782210510Disabling compacts and flushes for region at 1675782210510Disabling writes for close at 1675782210510Writing region close event to WAL at 1675782210511 (+1 ms)Running coprocessor post-close hooks at 1675782210514 (+3 ms)Closed at 1675782210514 2023-02-07 15:03:30,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:30,516 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b4f5f4632eba30db65e6ad93d4d540d5, regionState=CLOSED 2023-02-07 15:03:30,516 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675782210516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782210516"}]},"ts":"1675782210516"} 2023-02-07 15:03:30,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 15:03:30,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure b4f5f4632eba30db65e6ad93d4d540d5, server=jenkins-hbase4.apache.org,44487,1675782207786 in 159 msec 2023-02-07 15:03:30,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 15:03:30,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4f5f4632eba30db65e6ad93d4d540d5, UNASSIGN in 164 msec 2023-02-07 15:03:30,521 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782210521"}]},"ts":"1675782210521"} 2023-02-07 15:03:30,522 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-07 15:03:30,523 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-07 15:03:30,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 174 msec 2023-02-07 15:03:30,654 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,654 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:30,656 INFO [Listener at localhost/42341] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-07 15:03:30,656 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,656 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,656 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,659 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,659 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,659 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,659 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:30,662 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:30,664 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1, FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2, FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/recovered.edits] 2023-02-07 15:03:30,671 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/a18d3c45f82a492997c015ab4d48269b to hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/archive/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/a18d3c45f82a492997c015ab4d48269b 2023-02-07 15:03:30,672 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/d5f2448c224c4b598ca2b419e67abe61 to hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/archive/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f1/d5f2448c224c4b598ca2b419e67abe61 2023-02-07 15:03:30,674 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/5ece7e1efbfd452abf4fa3169db7b17f to hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/archive/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/5ece7e1efbfd452abf4fa3169db7b17f 2023-02-07 15:03:30,675 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/f6d9c0076db74742b57292df5bbde54c to hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/archive/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/f2/f6d9c0076db74742b57292df5bbde54c 2023-02-07 15:03:30,677 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/recovered.edits/12.seqid to hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/archive/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5/recovered.edits/12.seqid 2023-02-07 15:03:30,678 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4f5f4632eba30db65e6ad93d4d540d5 2023-02-07 15:03:30,678 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-07 15:03:30,679 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,681 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-07 15:03:30,682 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-07 15:03:30,683 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,683 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-07 15:03:30,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782210683"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:30,685 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 15:03:30,685 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b4f5f4632eba30db65e6ad93d4d540d5, NAME => 'testWithMockedMapReduceSingleRegion,,1675782208828.b4f5f4632eba30db65e6ad93d4d540d5.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 15:03:30,685 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-07 15:03:30,685 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675782210685"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:30,686 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-07 15:03:30,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 15:03:30,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 32 msec 2023-02-07 15:03:30,760 INFO [Listener at localhost/42341] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:30,760 INFO [Listener at localhost/42341] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:30,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42263] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:30,762 INFO [Listener at localhost/42341] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-07 15:03:30,762 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 15:03:30,762 INFO [Listener at localhost/42341] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 15:03:30,762 DEBUG [Listener at localhost/42341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x446e9cdb to 127.0.0.1:61362 2023-02-07 15:03:30,762 DEBUG [Listener at localhost/42341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:30,762 DEBUG [Listener at localhost/42341] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 15:03:30,762 DEBUG [Listener at localhost/42341] util.JVMClusterUtil(257): Found active master hash=1055976085, stopped=false 2023-02-07 15:03:30,763 INFO [Listener at localhost/42341] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:30,764 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:30,764 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:30,764 INFO [Listener at localhost/42341] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 15:03:30,764 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:30,764 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:30,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:30,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:30,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:30,766 DEBUG [Listener at localhost/42341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c719fb4 to 127.0.0.1:61362 2023-02-07 15:03:30,766 DEBUG [Listener at localhost/42341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:30,766 INFO [Listener at localhost/42341] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40895,1675782207753' ***** 2023-02-07 15:03:30,766 INFO [Listener at localhost/42341] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:30,767 INFO [Listener at localhost/42341] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44487,1675782207786' ***** 2023-02-07 15:03:30,767 INFO [Listener at localhost/42341] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:30,767 INFO [RS:0;jenkins-hbase4:40895] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:30,767 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:30,767 INFO [RS:0;jenkins-hbase4:40895] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:30,767 INFO [RS:1;jenkins-hbase4:44487] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:30,768 INFO [RS:0;jenkins-hbase4:40895] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:30,768 INFO [RS:1;jenkins-hbase4:44487] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:30,768 INFO [RS:1;jenkins-hbase4:44487] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:30,768 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(3304): Received CLOSE for 7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:30,768 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:30,768 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:30,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7a0456f27adaf1ba2e2609e43e44c991, disabling compactions & flushes 2023-02-07 15:03:30,769 DEBUG [RS:1;jenkins-hbase4:44487] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43ef0bbc to 127.0.0.1:61362 2023-02-07 15:03:30,768 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,769 DEBUG [RS:1;jenkins-hbase4:44487] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:30,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:30,769 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:30,769 DEBUG [RS:0;jenkins-hbase4:40895] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x272d41b0 to 127.0.0.1:61362 2023-02-07 15:03:30,769 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1479): Online Regions={7a0456f27adaf1ba2e2609e43e44c991=hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991.} 2023-02-07 15:03:30,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:30,770 DEBUG [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1505): Waiting on 7a0456f27adaf1ba2e2609e43e44c991 2023-02-07 15:03:30,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. after waiting 0 ms 2023-02-07 15:03:30,769 DEBUG [RS:0;jenkins-hbase4:40895] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:30,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:30,770 INFO [RS:0;jenkins-hbase4:40895] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:30,770 INFO [RS:0;jenkins-hbase4:40895] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:30,770 INFO [RS:0;jenkins-hbase4:40895] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:30,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 7a0456f27adaf1ba2e2609e43e44c991 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 15:03:30,770 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 15:03:30,770 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:30,770 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 15:03:30,770 DEBUG [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:30,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:30,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:30,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:30,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:30,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:30,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-07 15:03:30,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/.tmp/info/4967f1147ec34e469e5a9884dc6f054f 2023-02-07 15:03:30,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/.tmp/info/f2597e0fc568416aba88862f0b3925eb 2023-02-07 15:03:30,781 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2597e0fc568416aba88862f0b3925eb 2023-02-07 15:03:30,782 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:30,782 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:30,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/.tmp/info/4967f1147ec34e469e5a9884dc6f054f as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/info/4967f1147ec34e469e5a9884dc6f054f 2023-02-07 15:03:30,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/info/4967f1147ec34e469e5a9884dc6f054f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 15:03:30,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7a0456f27adaf1ba2e2609e43e44c991 in 18ms, sequenceid=6, compaction requested=false 2023-02-07 15:03:30,791 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/.tmp/rep_barrier/638e864cb79e40f7a5918a44d0ecc174 2023-02-07 15:03:30,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/namespace/7a0456f27adaf1ba2e2609e43e44c991/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 15:03:30,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:30,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7a0456f27adaf1ba2e2609e43e44c991: Waiting for close lock at 1675782210768Running coprocessor pre-close hooks at 1675782210768Disabling compacts and flushes for region at 1675782210768Disabling writes for close at 1675782210770 (+2 ms)Obtaining lock to block concurrent updates at 1675782210770Preparing flush snapshotting stores in 7a0456f27adaf1ba2e2609e43e44c991 at 1675782210770Finished memstore snapshotting hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675782210770Flushing stores of hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. at 1675782210771 (+1 ms)Flushing 7a0456f27adaf1ba2e2609e43e44c991/info: creating writer at 1675782210771Flushing 7a0456f27adaf1ba2e2609e43e44c991/info: appending metadata at 1675782210773 (+2 ms)Flushing 7a0456f27adaf1ba2e2609e43e44c991/info: closing flushed file at 1675782210773Flushing 7a0456f27adaf1ba2e2609e43e44c991/info: reopening flushed file at 1675782210784 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7a0456f27adaf1ba2e2609e43e44c991 in 18ms, sequenceid=6, compaction requested=false at 1675782210788 (+4 ms)Writing region close event to WAL at 1675782210791 (+3 ms)Running coprocessor post-close hooks at 1675782210794 (+3 ms)Closed at 1675782210794 2023-02-07 15:03:30,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 638e864cb79e40f7a5918a44d0ecc174 2023-02-07 15:03:30,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675782208328.7a0456f27adaf1ba2e2609e43e44c991. 2023-02-07 15:03:30,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/.tmp/table/8d728d8a05c7437fbd8368c30ff02f75 2023-02-07 15:03:30,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d728d8a05c7437fbd8368c30ff02f75 2023-02-07 15:03:30,805 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/.tmp/info/f2597e0fc568416aba88862f0b3925eb as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/info/f2597e0fc568416aba88862f0b3925eb 2023-02-07 15:03:30,809 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2597e0fc568416aba88862f0b3925eb 2023-02-07 15:03:30,809 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/info/f2597e0fc568416aba88862f0b3925eb, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 15:03:30,810 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/.tmp/rep_barrier/638e864cb79e40f7a5918a44d0ecc174 as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/rep_barrier/638e864cb79e40f7a5918a44d0ecc174 2023-02-07 15:03:30,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 638e864cb79e40f7a5918a44d0ecc174 2023-02-07 15:03:30,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/rep_barrier/638e864cb79e40f7a5918a44d0ecc174, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 15:03:30,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/.tmp/table/8d728d8a05c7437fbd8368c30ff02f75 as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/table/8d728d8a05c7437fbd8368c30ff02f75 2023-02-07 15:03:30,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d728d8a05c7437fbd8368c30ff02f75 2023-02-07 15:03:30,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/table/8d728d8a05c7437fbd8368c30ff02f75, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 15:03:30,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-07 15:03:30,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 15:03:30,824 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:30,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:30,824 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782210770Running coprocessor pre-close hooks at 1675782210770Disabling compacts and flushes for region at 1675782210770Disabling writes for close at 1675782210770Obtaining lock to block concurrent updates at 1675782210771 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675782210771Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675782210771Flushing stores of hbase:meta,,1.1588230740 at 1675782210771Flushing 1588230740/info: creating writer at 1675782210771Flushing 1588230740/info: appending metadata at 1675782210773 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675782210773Flushing 1588230740/rep_barrier: creating writer at 1675782210783 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675782210785 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675782210785Flushing 1588230740/table: creating writer at 1675782210795 (+10 ms)Flushing 1588230740/table: appending metadata at 1675782210796 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675782210796Flushing 1588230740/info: reopening flushed file at 1675782210806 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675782210810 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675782210814 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false at 1675782210820 (+6 ms)Writing region close event to WAL at 1675782210821 (+1 ms)Running coprocessor post-close hooks at 1675782210824 (+3 ms)Closed at 1675782210824 2023-02-07 15:03:30,824 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:30,970 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44487,1675782207786; all regions closed. 2023-02-07 15:03:30,970 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40895,1675782207753; all regions closed. 2023-02-07 15:03:30,972 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/WALs/jenkins-hbase4.apache.org,44487,1675782207786/jenkins-hbase4.apache.org%2C44487%2C1675782207786.1675782208678 not finished, retry = 0 2023-02-07 15:03:30,974 DEBUG [RS:0;jenkins-hbase4:40895] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/oldWALs 2023-02-07 15:03:30,974 INFO [RS:0;jenkins-hbase4:40895] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40895%2C1675782207753.meta:.meta(num 1675782208277) 2023-02-07 15:03:30,980 DEBUG [RS:0;jenkins-hbase4:40895] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/oldWALs 2023-02-07 15:03:30,980 INFO [RS:0;jenkins-hbase4:40895] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40895%2C1675782207753:(num 1675782209096) 2023-02-07 15:03:30,980 DEBUG [RS:0;jenkins-hbase4:40895] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:30,980 INFO [RS:0;jenkins-hbase4:40895] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:30,980 INFO [RS:0;jenkins-hbase4:40895] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:30,980 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:30,981 INFO [RS:0;jenkins-hbase4:40895] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40895 2023-02-07 15:03:30,982 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,983 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40895,1675782207753 2023-02-07 15:03:30,983 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2be85852 rejected from java.util.concurrent.ThreadPoolExecutor@2fd7d9f7[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:30,983 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:30,983 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:30,983 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:30,983 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32b66e3e rejected from java.util.concurrent.ThreadPoolExecutor@2fd7d9f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:30,984 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40895,1675782207753] 2023-02-07 15:03:30,984 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40895,1675782207753; numProcessing=1 2023-02-07 15:03:30,986 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40895,1675782207753 already deleted, retry=false 2023-02-07 15:03:30,986 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40895,1675782207753 expired; onlineServers=1 2023-02-07 15:03:31,063 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 15:03:31,063 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 15:03:31,074 DEBUG [RS:1;jenkins-hbase4:44487] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/oldWALs 2023-02-07 15:03:31,074 INFO [RS:1;jenkins-hbase4:44487] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44487%2C1675782207786:(num 1675782208678) 2023-02-07 15:03:31,074 DEBUG [RS:1;jenkins-hbase4:44487] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:31,074 INFO [RS:1;jenkins-hbase4:44487] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:31,075 INFO [RS:1;jenkins-hbase4:44487] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:31,075 INFO [RS:1;jenkins-hbase4:44487] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:31,075 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:31,075 INFO [RS:1;jenkins-hbase4:44487] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:31,075 INFO [RS:1;jenkins-hbase4:44487] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:31,076 INFO [RS:1;jenkins-hbase4:44487] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44487 2023-02-07 15:03:31,077 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:31,077 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44487,1675782207786 2023-02-07 15:03:31,078 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@758e23a rejected from java.util.concurrent.ThreadPoolExecutor@3676609[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:31,078 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44487,1675782207786] 2023-02-07 15:03:31,078 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44487,1675782207786; numProcessing=2 2023-02-07 15:03:31,079 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44487,1675782207786 already deleted, retry=false 2023-02-07 15:03:31,079 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44487,1675782207786 expired; onlineServers=0 2023-02-07 15:03:31,079 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42263,1675782207707' ***** 2023-02-07 15:03:31,079 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 15:03:31,080 DEBUG [M:0;jenkins-hbase4:42263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3acf6993, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:31,080 INFO [M:0;jenkins-hbase4:42263] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42263,1675782207707 2023-02-07 15:03:31,080 INFO [M:0;jenkins-hbase4:42263] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42263,1675782207707; all regions closed. 2023-02-07 15:03:31,080 DEBUG [M:0;jenkins-hbase4:42263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:31,081 DEBUG [M:0;jenkins-hbase4:42263] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 15:03:31,081 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 15:03:31,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782207921] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782207921,5,FailOnTimeoutGroup] 2023-02-07 15:03:31,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782207921] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782207921,5,FailOnTimeoutGroup] 2023-02-07 15:03:31,081 DEBUG [M:0;jenkins-hbase4:42263] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 15:03:31,082 INFO [M:0;jenkins-hbase4:42263] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 15:03:31,082 INFO [M:0;jenkins-hbase4:42263] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 15:03:31,082 INFO [M:0;jenkins-hbase4:42263] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 15:03:31,082 DEBUG [M:0;jenkins-hbase4:42263] master.HMaster(1502): Stopping service threads 2023-02-07 15:03:31,082 INFO [M:0;jenkins-hbase4:42263] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 15:03:31,083 ERROR [M:0;jenkins-hbase4:42263] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 15:03:31,083 INFO [M:0;jenkins-hbase4:42263] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 15:03:31,083 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 15:03:31,084 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:31,084 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:31,084 DEBUG [M:0;jenkins-hbase4:42263] zookeeper.ZKUtil(398): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 15:03:31,084 WARN [M:0;jenkins-hbase4:42263] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 15:03:31,084 INFO [M:0;jenkins-hbase4:42263] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 15:03:31,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:31,084 INFO [M:0;jenkins-hbase4:42263] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 15:03:31,084 DEBUG [M:0;jenkins-hbase4:42263] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:31,085 INFO [M:0;jenkins-hbase4:42263] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:31,085 DEBUG [M:0;jenkins-hbase4:42263] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:31,085 DEBUG [M:0;jenkins-hbase4:42263] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:31,085 DEBUG [M:0;jenkins-hbase4:42263] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:31,085 INFO [M:0;jenkins-hbase4:42263] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.07 KB 2023-02-07 15:03:31,094 INFO [M:0;jenkins-hbase4:42263] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4626c12979d84db6b11121d9874ca946 2023-02-07 15:03:31,097 DEBUG [M:0;jenkins-hbase4:42263] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4626c12979d84db6b11121d9874ca946 as hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4626c12979d84db6b11121d9874ca946 2023-02-07 15:03:31,101 INFO [M:0;jenkins-hbase4:42263] regionserver.HStore(1080): Added hdfs://localhost:46217/user/jenkins/test-data/f4a87bb3-5280-d396-7c6a-d4dee57fb4ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4626c12979d84db6b11121d9874ca946, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 15:03:31,101 INFO [M:0;jenkins-hbase4:42263] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-07 15:03:31,102 INFO [M:0;jenkins-hbase4:42263] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:31,102 DEBUG [M:0;jenkins-hbase4:42263] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782211084Disabling compacts and flushes for region at 1675782211084Disabling writes for close at 1675782211085 (+1 ms)Obtaining lock to block concurrent updates at 1675782211085Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675782211085Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57497, getHeapSize=68664, getOffHeapSize=0, getCellsCount=145 at 1675782211085Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675782211086 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675782211086Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675782211088 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675782211088Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675782211098 (+10 ms)Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675782211102 (+4 ms)Writing region close event to WAL at 1675782211102Closed at 1675782211102 2023-02-07 15:03:31,104 INFO [M:0;jenkins-hbase4:42263] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 15:03:31,104 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:31,105 INFO [M:0;jenkins-hbase4:42263] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42263 2023-02-07 15:03:31,107 DEBUG [M:0;jenkins-hbase4:42263] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42263,1675782207707 already deleted, retry=false 2023-02-07 15:03:31,267 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:31,267 INFO [M:0;jenkins-hbase4:42263] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42263,1675782207707; zookeeper connection closed. 2023-02-07 15:03:31,267 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37e56e4f rejected from java.util.concurrent.ThreadPoolExecutor@33dafc6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:31,268 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): master:42263-0x1002f4f228d0000, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:31,268 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b6faffb rejected from java.util.concurrent.ThreadPoolExecutor@33dafc6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:31,367 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:31,367 INFO [RS:1;jenkins-hbase4:44487] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44487,1675782207786; zookeeper connection closed. 2023-02-07 15:03:31,367 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37e0d171 rejected from java.util.concurrent.ThreadPoolExecutor@3676609[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:31,368 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:44487-0x1002f4f228d0002, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:31,368 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@ca929ca] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@ca929ca 2023-02-07 15:03:31,368 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f06cb4f rejected from java.util.concurrent.ThreadPoolExecutor@3676609[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:31,467 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:31,468 INFO [RS:0;jenkins-hbase4:40895] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40895,1675782207753; zookeeper connection closed. 2023-02-07 15:03:31,468 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a7cf81a rejected from java.util.concurrent.ThreadPoolExecutor@2fd7d9f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:31,470 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f20d01e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f20d01e 2023-02-07 15:03:31,470 DEBUG [Listener at localhost/42341-EventThread] zookeeper.ZKWatcher(600): regionserver:40895-0x1002f4f228d0001, quorum=127.0.0.1:61362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:31,471 ERROR [Listener at localhost/42341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b3ce5d9 rejected from java.util.concurrent.ThreadPoolExecutor@2fd7d9f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:31,471 INFO [Listener at localhost/42341] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 15:03:31,472 WARN [Listener at localhost/42341] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:31,476 INFO [Listener at localhost/42341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:31,581 WARN [BP-1090212540-172.31.14.131-1675782207108 heartbeating to localhost/127.0.0.1:46217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:31,581 WARN [BP-1090212540-172.31.14.131-1675782207108 heartbeating to localhost/127.0.0.1:46217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1090212540-172.31.14.131-1675782207108 (Datanode Uuid 58152bc9-b714-4d36-8500-15ac8909fd43) service to localhost/127.0.0.1:46217 2023-02-07 15:03:31,581 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e/dfs/data/data3/current/BP-1090212540-172.31.14.131-1675782207108] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:31,582 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e/dfs/data/data4/current/BP-1090212540-172.31.14.131-1675782207108] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:31,582 WARN [Listener at localhost/42341] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:31,587 INFO [Listener at localhost/42341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:31,690 WARN [BP-1090212540-172.31.14.131-1675782207108 heartbeating to localhost/127.0.0.1:46217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:31,690 WARN [BP-1090212540-172.31.14.131-1675782207108 heartbeating to localhost/127.0.0.1:46217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1090212540-172.31.14.131-1675782207108 (Datanode Uuid 60730337-f96e-42b6-94a4-ba61548a6a77) service to localhost/127.0.0.1:46217 2023-02-07 15:03:31,690 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e/dfs/data/data1/current/BP-1090212540-172.31.14.131-1675782207108] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:31,691 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/cluster_0750fced-2392-43d2-dc86-e6b0dc81643e/dfs/data/data2/current/BP-1090212540-172.31.14.131-1675782207108] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:31,702 INFO [Listener at localhost/42341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:31,815 INFO [Listener at localhost/42341] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 15:03:31,834 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 15:03:31,846 INFO [Listener at localhost/42341] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 231) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46217 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42263,1675782207707)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:46217 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42341 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46217 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:46217 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42341.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46217 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46217 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:46217 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=666 (was 649) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 291), ProcessCount=166 (was 166), AvailableMemoryMB=5439 (was 5474) 2023-02-07 15:03:31,856 INFO [Listener at localhost/42341] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=666, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=166, AvailableMemoryMB=5439 2023-02-07 15:03:31,867 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/hadoop.log.dir so I do NOT create it in target/test-data/c675766d-280b-647c-0885-45a110834937 2023-02-07 15:03:31,867 WARN [Listener at localhost/42341] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 15:03:31,867 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/hadoop.tmp.dir so I do NOT create it in target/test-data/c675766d-280b-647c-0885-45a110834937 2023-02-07 15:03:31,867 WARN [Listener at localhost/42341] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23838715-b7f6-a429-6c0f-5d636f0cd01a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 15:03:31,867 DEBUG [Listener at localhost/42341] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937 2023-02-07 15:03:31,867 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 15:03:31,867 INFO [Listener at localhost/42341] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4, deleteOnExit=true 2023-02-07 15:03:31,867 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 15:03:31,867 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/test.cache.data in system properties and HBase conf 2023-02-07 15:03:31,867 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/hadoop.log.dir in system properties and HBase conf 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 15:03:31,868 DEBUG [Listener at localhost/42341] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 15:03:31,868 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/nfs.dump.dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/java.io.tmpdir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 15:03:31,869 INFO [Listener at localhost/42341] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 15:03:31,873 WARN [Listener at localhost/42341] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:31,874 WARN [Listener at localhost/42341] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:31,911 WARN [Listener at localhost/42341] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:31,913 INFO [Listener at localhost/42341] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:31,918 INFO [Listener at localhost/42341] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/java.io.tmpdir/Jetty_localhost_41701_hdfs____lv0y2t/webapp 2023-02-07 15:03:32,010 INFO [Listener at localhost/42341] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41701 2023-02-07 15:03:32,015 WARN [Listener at localhost/42341] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:32,015 WARN [Listener at localhost/42341] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:32,053 WARN [Listener at localhost/36999] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:32,068 WARN [Listener at localhost/36999] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:32,072 WARN [Listener at localhost/36999] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:32,073 INFO [Listener at localhost/36999] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:32,079 INFO [Listener at localhost/36999] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/java.io.tmpdir/Jetty_localhost_42851_datanode____6zobjx/webapp 2023-02-07 15:03:32,174 INFO [Listener at localhost/36999] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42851 2023-02-07 15:03:32,183 WARN [Listener at localhost/32807] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:32,207 WARN [Listener at localhost/32807] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:32,210 WARN [Listener at localhost/32807] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:32,210 INFO [Listener at localhost/32807] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:32,213 INFO [Listener at localhost/32807] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/java.io.tmpdir/Jetty_localhost_38005_datanode____.u0ohnt/webapp 2023-02-07 15:03:32,251 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:32,300 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd83fcc014099852: Processing first storage report for DS-fabc287f-438a-434f-b0d0-66622df38a0f from datanode d39488b0-1baa-40a8-ab63-86fe96148a7d 2023-02-07 15:03:32,300 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd83fcc014099852: from storage DS-fabc287f-438a-434f-b0d0-66622df38a0f node DatanodeRegistration(127.0.0.1:36993, datanodeUuid=d39488b0-1baa-40a8-ab63-86fe96148a7d, infoPort=41409, infoSecurePort=0, ipcPort=32807, storageInfo=lv=-57;cid=testClusterID;nsid=1258798649;c=1675782211876), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:32,300 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd83fcc014099852: Processing first storage report for DS-1d5bbbc9-07bb-4746-b88f-70591d667004 from datanode d39488b0-1baa-40a8-ab63-86fe96148a7d 2023-02-07 15:03:32,300 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd83fcc014099852: from storage DS-1d5bbbc9-07bb-4746-b88f-70591d667004 node DatanodeRegistration(127.0.0.1:36993, datanodeUuid=d39488b0-1baa-40a8-ab63-86fe96148a7d, infoPort=41409, infoSecurePort=0, ipcPort=32807, storageInfo=lv=-57;cid=testClusterID;nsid=1258798649;c=1675782211876), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:32,309 INFO [Listener at localhost/32807] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38005 2023-02-07 15:03:32,317 WARN [Listener at localhost/35155] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:32,415 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6fdce14cac5cd85: Processing first storage report for DS-e4990f13-61d8-42bc-9ac3-c71063979678 from datanode 86815d26-9ec0-4fe7-a5bb-543e78375b9e 2023-02-07 15:03:32,415 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6fdce14cac5cd85: from storage DS-e4990f13-61d8-42bc-9ac3-c71063979678 node DatanodeRegistration(127.0.0.1:40389, datanodeUuid=86815d26-9ec0-4fe7-a5bb-543e78375b9e, infoPort=40485, infoSecurePort=0, ipcPort=35155, storageInfo=lv=-57;cid=testClusterID;nsid=1258798649;c=1675782211876), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 15:03:32,415 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6fdce14cac5cd85: Processing first storage report for DS-3a9a12c0-7ff0-48d6-83ab-92d7c5436e20 from datanode 86815d26-9ec0-4fe7-a5bb-543e78375b9e 2023-02-07 15:03:32,415 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6fdce14cac5cd85: from storage DS-3a9a12c0-7ff0-48d6-83ab-92d7c5436e20 node DatanodeRegistration(127.0.0.1:40389, datanodeUuid=86815d26-9ec0-4fe7-a5bb-543e78375b9e, infoPort=40485, infoSecurePort=0, ipcPort=35155, storageInfo=lv=-57;cid=testClusterID;nsid=1258798649;c=1675782211876), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:32,426 DEBUG [Listener at localhost/35155] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937 2023-02-07 15:03:32,428 INFO [Listener at localhost/35155] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4/zookeeper_0, clientPort=61894, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 15:03:32,429 INFO [Listener at localhost/35155] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61894 2023-02-07 15:03:32,429 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,430 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,445 INFO [Listener at localhost/35155] util.FSUtils(479): Created version file at hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556 with version=8 2023-02-07 15:03:32,445 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,446 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,447 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36999/user/jenkins/test-data/33cdf9d3-c527-b547-bbf5-0fab447bf49c/hbase-staging 2023-02-07 15:03:32,449 INFO [Listener at localhost/35155] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:32,449 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,449 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,449 INFO [Listener at localhost/35155] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:32,449 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,450 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:32,450 INFO [Listener at localhost/35155] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:32,451 INFO [Listener at localhost/35155] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45051 2023-02-07 15:03:32,451 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,452 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,452 INFO [Listener at localhost/35155] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45051 connecting to ZooKeeper ensemble=127.0.0.1:61894 2023-02-07 15:03:32,462 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:450510x0, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:32,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45051-0x1002f4f35110000 connected 2023-02-07 15:03:32,480 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:32,481 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:32,481 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:32,482 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45051 2023-02-07 15:03:32,484 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45051 2023-02-07 15:03:32,485 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45051 2023-02-07 15:03:32,486 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45051 2023-02-07 15:03:32,487 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45051 2023-02-07 15:03:32,487 INFO [Listener at localhost/35155] master.HMaster(439): hbase.rootdir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556, hbase.cluster.distributed=false 2023-02-07 15:03:32,499 INFO [Listener at localhost/35155] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:32,499 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,499 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,499 INFO [Listener at localhost/35155] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:32,499 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,500 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:32,500 INFO [Listener at localhost/35155] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:32,504 INFO [Listener at localhost/35155] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41197 2023-02-07 15:03:32,504 INFO [Listener at localhost/35155] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:32,504 DEBUG [Listener at localhost/35155] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:32,505 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,506 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,506 INFO [Listener at localhost/35155] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41197 connecting to ZooKeeper ensemble=127.0.0.1:61894 2023-02-07 15:03:32,508 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:411970x0, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:32,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41197-0x1002f4f35110001 connected 2023-02-07 15:03:32,509 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:32,510 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:32,510 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:32,512 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41197 2023-02-07 15:03:32,513 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41197 2023-02-07 15:03:32,514 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41197 2023-02-07 15:03:32,514 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41197 2023-02-07 15:03:32,514 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41197 2023-02-07 15:03:32,524 INFO [Listener at localhost/35155] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:32,525 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,525 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,525 INFO [Listener at localhost/35155] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:32,525 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:32,525 INFO [Listener at localhost/35155] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:32,525 INFO [Listener at localhost/35155] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:32,526 INFO [Listener at localhost/35155] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43919 2023-02-07 15:03:32,526 INFO [Listener at localhost/35155] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:32,526 DEBUG [Listener at localhost/35155] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:32,527 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,528 INFO [Listener at localhost/35155] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,528 INFO [Listener at localhost/35155] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43919 connecting to ZooKeeper ensemble=127.0.0.1:61894 2023-02-07 15:03:32,530 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:439190x0, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:32,531 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): regionserver:439190x0, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:32,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43919-0x1002f4f35110002 connected 2023-02-07 15:03:32,532 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:32,532 DEBUG [Listener at localhost/35155] zookeeper.ZKUtil(164): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:32,535 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43919 2023-02-07 15:03:32,536 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43919 2023-02-07 15:03:32,536 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43919 2023-02-07 15:03:32,536 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43919 2023-02-07 15:03:32,540 DEBUG [Listener at localhost/35155] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43919 2023-02-07 15:03:32,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:32,543 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:32,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:32,545 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:32,545 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:32,545 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:32,545 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:32,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:32,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45051,1675782212448 from backup master directory 2023-02-07 15:03:32,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:32,549 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:32,549 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:32,549 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:32,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:32,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/hbase.id with ID: 6d931aca-cacf-43c4-821b-1a0042a7a311 2023-02-07 15:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:32,572 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:32,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6e64f3b0 to 127.0.0.1:61894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:32,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cd51238, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:32,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:32,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 15:03:32,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:32,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store-tmp 2023-02-07 15:03:32,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:32,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:32,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:32,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:32,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:32,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:32,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:32,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782212597Disabling compacts and flushes for region at 1675782212597Disabling writes for close at 1675782212597Writing region close event to WAL at 1675782212597Closed at 1675782212597 2023-02-07 15:03:32,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/WALs/jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:32,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45051%2C1675782212448, suffix=, logDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/WALs/jenkins-hbase4.apache.org,45051,1675782212448, archiveDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/oldWALs, maxLogs=10 2023-02-07 15:03:32,611 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK] 2023-02-07 15:03:32,612 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK] 2023-02-07 15:03:32,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/WALs/jenkins-hbase4.apache.org,45051,1675782212448/jenkins-hbase4.apache.org%2C45051%2C1675782212448.1675782212600 2023-02-07 15:03:32,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK]] 2023-02-07 15:03:32,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:32,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:32,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:32,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:32,615 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:32,616 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 15:03:32,616 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 15:03:32,616 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:32,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:32,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:32,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:32,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:32,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62896961, jitterRate=-0.06276224553585052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:32,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675782212614Initializing all the Stores at 1675782212614Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782212614Cleaning up temporary data from old regions at 1675782212617 (+3 ms)Cleaning up detritus from prior splits at 1675782212618 (+1 ms)Region opened successfully at 1675782212620 (+2 ms) 2023-02-07 15:03:32,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 15:03:32,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 15:03:32,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 15:03:32,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 15:03:32,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 15:03:32,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 15:03:32,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 15:03:32,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 15:03:32,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 15:03:32,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 15:03:32,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 15:03:32,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 15:03:32,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 15:03:32,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 15:03:32,636 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 15:03:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 15:03:32,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 15:03:32,639 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:32,639 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:32,639 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:32,639 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:32,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45051,1675782212448, sessionid=0x1002f4f35110000, setting cluster-up flag (Was=false) 2023-02-07 15:03:32,644 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:32,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 15:03:32,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:32,652 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:32,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 15:03:32,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:32,657 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.hbase-snapshot/.tmp 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:32,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675782242660 2023-02-07 15:03:32,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 15:03:32,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 15:03:32,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 15:03:32,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 15:03:32,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 15:03:32,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 15:03:32,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,663 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:32,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 15:03:32,663 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 15:03:32,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 15:03:32,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 15:03:32,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 15:03:32,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 15:03:32,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782212664,5,FailOnTimeoutGroup] 2023-02-07 15:03:32,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782212664,5,FailOnTimeoutGroup] 2023-02-07 15:03:32,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 15:03:32,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,664 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:32,673 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:32,673 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:32,673 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556 2023-02-07 15:03:32,682 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:32,682 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:32,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/info 2023-02-07 15:03:32,684 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:32,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:32,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:32,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:32,685 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:32,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:32,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:32,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/table 2023-02-07 15:03:32,687 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:32,687 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:32,687 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740 2023-02-07 15:03:32,688 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740 2023-02-07 15:03:32,689 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:32,690 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:32,691 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:32,691 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73118458, jitterRate=0.08954992890357971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:32,692 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675782212682Initializing all the Stores at 1675782212682Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782212682Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782212682Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782212682Cleaning up temporary data from old regions at 1675782212688 (+6 ms)Cleaning up detritus from prior splits at 1675782212689 (+1 ms)Region opened successfully at 1675782212691 (+2 ms) 2023-02-07 15:03:32,692 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:32,692 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:32,692 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:32,692 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:32,692 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:32,692 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:32,692 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782212692Disabling compacts and flushes for region at 1675782212692Disabling writes for close at 1675782212692Writing region close event to WAL at 1675782212692Closed at 1675782212692 2023-02-07 15:03:32,693 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:32,693 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 15:03:32,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 15:03:32,694 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 15:03:32,695 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 15:03:32,743 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(952): ClusterId : 6d931aca-cacf-43c4-821b-1a0042a7a311 2023-02-07 15:03:32,743 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(952): ClusterId : 6d931aca-cacf-43c4-821b-1a0042a7a311 2023-02-07 15:03:32,743 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:32,743 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:32,746 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:32,746 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:32,746 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:32,746 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:32,748 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:32,749 DEBUG [RS:1;jenkins-hbase4:43919] zookeeper.ReadOnlyZKClient(139): Connect 0x507a496b to 127.0.0.1:61894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:32,749 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:32,750 DEBUG [RS:0;jenkins-hbase4:41197] zookeeper.ReadOnlyZKClient(139): Connect 0x5c8f7f2c to 127.0.0.1:61894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:32,753 DEBUG [RS:1;jenkins-hbase4:43919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ebdbd14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:32,754 DEBUG [RS:0;jenkins-hbase4:41197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52488acd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:32,754 DEBUG [RS:1;jenkins-hbase4:43919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a82221b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:32,754 DEBUG [RS:0;jenkins-hbase4:41197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5677145c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:32,766 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41197 2023-02-07 15:03:32,766 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43919 2023-02-07 15:03:32,766 INFO [RS:0;jenkins-hbase4:41197] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:32,767 INFO [RS:0;jenkins-hbase4:41197] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:32,767 INFO [RS:1;jenkins-hbase4:43919] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:32,767 INFO [RS:1;jenkins-hbase4:43919] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:32,767 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:32,767 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:32,767 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45051,1675782212448 with isa=jenkins-hbase4.apache.org/172.31.14.131:43919, startcode=1675782212524 2023-02-07 15:03:32,767 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45051,1675782212448 with isa=jenkins-hbase4.apache.org/172.31.14.131:41197, startcode=1675782212499 2023-02-07 15:03:32,767 DEBUG [RS:1;jenkins-hbase4:43919] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:32,768 DEBUG [RS:0;jenkins-hbase4:41197] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:32,769 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44891, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:32,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:32,771 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46557, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:32,771 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556 2023-02-07 15:03:32,771 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36999 2023-02-07 15:03:32,771 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:32,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:32,772 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556 2023-02-07 15:03:32,772 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36999 2023-02-07 15:03:32,772 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:32,773 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:32,776 DEBUG [RS:0;jenkins-hbase4:41197] zookeeper.ZKUtil(162): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:32,776 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41197,1675782212499] 2023-02-07 15:03:32,776 WARN [RS:0;jenkins-hbase4:41197] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:32,776 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43919,1675782212524] 2023-02-07 15:03:32,776 INFO [RS:0;jenkins-hbase4:41197] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:32,776 DEBUG [RS:1;jenkins-hbase4:43919] zookeeper.ZKUtil(162): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:32,776 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:32,776 WARN [RS:1;jenkins-hbase4:43919] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:32,776 INFO [RS:1;jenkins-hbase4:43919] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:32,776 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:32,781 DEBUG [RS:0;jenkins-hbase4:41197] zookeeper.ZKUtil(162): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:32,781 DEBUG [RS:1;jenkins-hbase4:43919] zookeeper.ZKUtil(162): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:32,781 DEBUG [RS:0;jenkins-hbase4:41197] zookeeper.ZKUtil(162): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:32,781 DEBUG [RS:1;jenkins-hbase4:43919] zookeeper.ZKUtil(162): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:32,782 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:32,782 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:32,782 INFO [RS:1;jenkins-hbase4:43919] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:32,782 INFO [RS:0;jenkins-hbase4:41197] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:32,783 INFO [RS:1;jenkins-hbase4:43919] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:32,784 INFO [RS:1;jenkins-hbase4:43919] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:32,784 INFO [RS:1;jenkins-hbase4:43919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,784 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:32,788 INFO [RS:0;jenkins-hbase4:41197] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:32,792 INFO [RS:1;jenkins-hbase4:43919] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,792 INFO [RS:0;jenkins-hbase4:41197] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 INFO [RS:0;jenkins-hbase4:41197] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,793 DEBUG [RS:1;jenkins-hbase4:43919] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,796 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:32,798 INFO [RS:1;jenkins-hbase4:43919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,798 INFO [RS:1;jenkins-hbase4:43919] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,798 INFO [RS:1;jenkins-hbase4:43919] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,798 INFO [RS:0;jenkins-hbase4:41197] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,799 DEBUG [RS:0;jenkins-hbase4:41197] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:32,810 INFO [RS:0;jenkins-hbase4:41197] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,810 INFO [RS:0;jenkins-hbase4:41197] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,811 INFO [RS:0;jenkins-hbase4:41197] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,816 INFO [RS:1;jenkins-hbase4:43919] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:32,816 INFO [RS:1;jenkins-hbase4:43919] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43919,1675782212524-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,823 INFO [RS:0;jenkins-hbase4:41197] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:32,823 INFO [RS:0;jenkins-hbase4:41197] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41197,1675782212499-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:32,832 INFO [RS:1;jenkins-hbase4:43919] regionserver.Replication(203): jenkins-hbase4.apache.org,43919,1675782212524 started 2023-02-07 15:03:32,832 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43919,1675782212524, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43919, sessionid=0x1002f4f35110002 2023-02-07 15:03:32,832 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:32,832 DEBUG [RS:1;jenkins-hbase4:43919] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:32,832 DEBUG [RS:1;jenkins-hbase4:43919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43919,1675782212524' 2023-02-07 15:03:32,832 DEBUG [RS:1;jenkins-hbase4:43919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:32,832 DEBUG [RS:1;jenkins-hbase4:43919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:32,833 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:32,833 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:32,833 DEBUG [RS:1;jenkins-hbase4:43919] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:32,833 DEBUG [RS:1;jenkins-hbase4:43919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43919,1675782212524' 2023-02-07 15:03:32,833 DEBUG [RS:1;jenkins-hbase4:43919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:32,833 DEBUG [RS:1;jenkins-hbase4:43919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:32,833 DEBUG [RS:1;jenkins-hbase4:43919] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:32,834 INFO [RS:1;jenkins-hbase4:43919] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:32,834 INFO [RS:1;jenkins-hbase4:43919] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:32,834 INFO [RS:0;jenkins-hbase4:41197] regionserver.Replication(203): jenkins-hbase4.apache.org,41197,1675782212499 started 2023-02-07 15:03:32,834 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41197,1675782212499, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41197, sessionid=0x1002f4f35110001 2023-02-07 15:03:32,834 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:32,834 DEBUG [RS:0;jenkins-hbase4:41197] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:32,834 DEBUG [RS:0;jenkins-hbase4:41197] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41197,1675782212499' 2023-02-07 15:03:32,834 DEBUG [RS:0;jenkins-hbase4:41197] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:32,834 DEBUG [RS:0;jenkins-hbase4:41197] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:32,835 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:32,835 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:32,835 DEBUG [RS:0;jenkins-hbase4:41197] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:32,835 DEBUG [RS:0;jenkins-hbase4:41197] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41197,1675782212499' 2023-02-07 15:03:32,835 DEBUG [RS:0;jenkins-hbase4:41197] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:32,835 DEBUG [RS:0;jenkins-hbase4:41197] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:32,835 DEBUG [RS:0;jenkins-hbase4:41197] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:32,835 INFO [RS:0;jenkins-hbase4:41197] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:32,835 INFO [RS:0;jenkins-hbase4:41197] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:32,845 DEBUG [jenkins-hbase4:45051] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 15:03:32,846 DEBUG [jenkins-hbase4:45051] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:32,847 DEBUG [jenkins-hbase4:45051] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:32,847 DEBUG [jenkins-hbase4:45051] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:32,847 DEBUG [jenkins-hbase4:45051] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:32,847 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43919,1675782212524, state=OPENING 2023-02-07 15:03:32,848 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 15:03:32,849 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:32,850 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:32,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43919,1675782212524}] 2023-02-07 15:03:33,005 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:33,005 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:33,006 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:33,010 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 15:03:33,010 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:33,011 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43919%2C1675782212524.meta, suffix=.meta, logDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,43919,1675782212524, archiveDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/oldWALs, maxLogs=32 2023-02-07 15:03:33,025 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK] 2023-02-07 15:03:33,025 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK] 2023-02-07 15:03:33,026 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,43919,1675782212524/jenkins-hbase4.apache.org%2C43919%2C1675782212524.meta.1675782213012.meta 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK]] 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 15:03:33,027 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 15:03:33,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 15:03:33,028 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:33,029 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/info 2023-02-07 15:03:33,029 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/info 2023-02-07 15:03:33,030 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:33,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:33,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:33,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:33,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:33,031 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:33,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:33,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:33,032 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/table 2023-02-07 15:03:33,032 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/table 2023-02-07 15:03:33,033 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:33,033 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:33,034 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740 2023-02-07 15:03:33,034 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740 2023-02-07 15:03:33,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:33,037 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:33,037 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75007295, jitterRate=0.11769579350948334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:33,037 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675782213027Writing region info on filesystem at 1675782213027Initializing all the Stores at 1675782213028 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782213028Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782213028Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782213028Cleaning up temporary data from old regions at 1675782213035 (+7 ms)Cleaning up detritus from prior splits at 1675782213035Running coprocessor post-open hooks at 1675782213037 (+2 ms)Region opened successfully at 1675782213037 2023-02-07 15:03:33,038 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675782213005 2023-02-07 15:03:33,041 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 15:03:33,042 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 15:03:33,042 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43919,1675782212524, state=OPEN 2023-02-07 15:03:33,044 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 15:03:33,044 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:33,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 15:03:33,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43919,1675782212524 in 194 msec 2023-02-07 15:03:33,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 15:03:33,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-07 15:03:33,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-07 15:03:33,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675782212543, completionTime=-1 2023-02-07 15:03:33,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 15:03:33,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 15:03:33,050 DEBUG [hconnection-0x6630651b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:33,051 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60292, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:33,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 15:03:33,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675782273052 2023-02-07 15:03:33,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675782333052 2023-02-07 15:03:33,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-07 15:03:33,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45051,1675782212448-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:33,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45051,1675782212448-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:33,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45051,1675782212448-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:33,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45051, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:33,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:33,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 15:03:33,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:33,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 15:03:33,062 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 15:03:33,063 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:33,063 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:33,064 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,065 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58 empty. 2023-02-07 15:03:33,065 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,065 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 15:03:33,073 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:33,073 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4d49d7deb9e6f0073e8922a6862fcd58, NAME => 'hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp 2023-02-07 15:03:33,079 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:33,079 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4d49d7deb9e6f0073e8922a6862fcd58, disabling compactions & flushes 2023-02-07 15:03:33,079 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:33,079 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:33,079 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. after waiting 0 ms 2023-02-07 15:03:33,079 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:33,079 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:33,079 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4d49d7deb9e6f0073e8922a6862fcd58: Waiting for close lock at 1675782213079Disabling compacts and flushes for region at 1675782213079Disabling writes for close at 1675782213079Writing region close event to WAL at 1675782213079Closed at 1675782213079 2023-02-07 15:03:33,081 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:33,081 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782213081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782213081"}]},"ts":"1675782213081"} 2023-02-07 15:03:33,083 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:33,083 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:33,083 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782213083"}]},"ts":"1675782213083"} 2023-02-07 15:03:33,084 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 15:03:33,088 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:33,088 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:33,088 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:33,088 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:33,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4d49d7deb9e6f0073e8922a6862fcd58, ASSIGN}] 2023-02-07 15:03:33,091 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4d49d7deb9e6f0073e8922a6862fcd58, ASSIGN 2023-02-07 15:03:33,092 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4d49d7deb9e6f0073e8922a6862fcd58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41197,1675782212499; forceNewPlan=false, retain=false 2023-02-07 15:03:33,242 INFO [jenkins-hbase4:45051] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:33,242 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4d49d7deb9e6f0073e8922a6862fcd58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:33,242 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782213242"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782213242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782213242"}]},"ts":"1675782213242"} 2023-02-07 15:03:33,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4d49d7deb9e6f0073e8922a6862fcd58, server=jenkins-hbase4.apache.org,41197,1675782212499}] 2023-02-07 15:03:33,397 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:33,397 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:33,399 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46792, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:33,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:33,403 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41197%2C1675782212499, suffix=, logDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,41197,1675782212499, archiveDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/oldWALs, maxLogs=32 2023-02-07 15:03:33,417 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK] 2023-02-07 15:03:33,417 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK] 2023-02-07 15:03:33,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,41197,1675782212499/jenkins-hbase4.apache.org%2C41197%2C1675782212499.1675782213404 2023-02-07 15:03:33,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK], DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK]] 2023-02-07 15:03:33,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d49d7deb9e6f0073e8922a6862fcd58, NAME => 'hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:33,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:33,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,421 INFO [StoreOpener-4d49d7deb9e6f0073e8922a6862fcd58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,422 DEBUG [StoreOpener-4d49d7deb9e6f0073e8922a6862fcd58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/info 2023-02-07 15:03:33,422 DEBUG [StoreOpener-4d49d7deb9e6f0073e8922a6862fcd58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/info 2023-02-07 15:03:33,422 INFO [StoreOpener-4d49d7deb9e6f0073e8922a6862fcd58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d49d7deb9e6f0073e8922a6862fcd58 columnFamilyName info 2023-02-07 15:03:33,423 INFO [StoreOpener-4d49d7deb9e6f0073e8922a6862fcd58-1] regionserver.HStore(310): Store=4d49d7deb9e6f0073e8922a6862fcd58/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:33,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,426 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:33,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:33,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d49d7deb9e6f0073e8922a6862fcd58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63857513, jitterRate=-0.04844890534877777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:33,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d49d7deb9e6f0073e8922a6862fcd58: Running coprocessor pre-open hook at 1675782213420Writing region info on filesystem at 1675782213420Initializing all the Stores at 1675782213420Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782213420Cleaning up temporary data from old regions at 1675782213424 (+4 ms)Cleaning up detritus from prior splits at 1675782213425 (+1 ms)Running coprocessor post-open hooks at 1675782213428 (+3 ms)Region opened successfully at 1675782213428 2023-02-07 15:03:33,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58., pid=6, masterSystemTime=1675782213397 2023-02-07 15:03:33,431 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:33,432 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:33,432 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4d49d7deb9e6f0073e8922a6862fcd58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:33,432 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782213432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782213432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782213432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782213432"}]},"ts":"1675782213432"} 2023-02-07 15:03:33,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 15:03:33,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4d49d7deb9e6f0073e8922a6862fcd58, server=jenkins-hbase4.apache.org,41197,1675782212499 in 189 msec 2023-02-07 15:03:33,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 15:03:33,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4d49d7deb9e6f0073e8922a6862fcd58, ASSIGN in 346 msec 2023-02-07 15:03:33,437 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:33,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782213437"}]},"ts":"1675782213437"} 2023-02-07 15:03:33,438 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 15:03:33,440 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:33,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-02-07 15:03:33,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 15:03:33,463 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:33,463 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:33,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:33,466 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46798, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:33,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 15:03:33,474 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:33,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-07 15:03:33,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 15:03:33,485 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:33,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-07 15:03:33,494 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 15:03:33,496 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 15:03:33,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.947sec 2023-02-07 15:03:33,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 15:03:33,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 15:03:33,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 15:03:33,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45051,1675782212448-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 15:03:33,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45051,1675782212448-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 15:03:33,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 15:03:33,543 DEBUG [Listener at localhost/35155] zookeeper.ReadOnlyZKClient(139): Connect 0x5c6003df to 127.0.0.1:61894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:33,546 DEBUG [Listener at localhost/35155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ad56249, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:33,548 DEBUG [hconnection-0x3e4647f1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:33,549 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:33,551 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:33,551 DEBUG [Listener at localhost/35155] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 15:03:33,551 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:33,551 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:33,553 DEBUG [Listener at localhost/35155] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 15:03:33,554 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47824, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 15:03:33,555 INFO [Listener at localhost/35155] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:33,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:33,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 15:03:33,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:47824 deadline: 1675782273555, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:33,555 INFO [Listener at localhost/35155] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 15:03:33,556 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:33,556 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:33,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:33,559 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:33,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-07 15:03:33,560 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:33,560 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:33,560 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:33,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:33,561 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,562 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde empty. 2023-02-07 15:03:33,562 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,562 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-07 15:03:33,570 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:33,571 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2d35fd20f7683cc4175a8c55e3ed0cde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp 2023-02-07 15:03:33,576 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:33,576 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 2d35fd20f7683cc4175a8c55e3ed0cde, disabling compactions & flushes 2023-02-07 15:03:33,576 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:33,576 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:33,576 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. after waiting 0 ms 2023-02-07 15:03:33,576 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:33,576 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:33,576 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 2d35fd20f7683cc4175a8c55e3ed0cde: Waiting for close lock at 1675782213576Disabling compacts and flushes for region at 1675782213576Disabling writes for close at 1675782213576Writing region close event to WAL at 1675782213576Closed at 1675782213576 2023-02-07 15:03:33,578 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:33,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675782213579"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782213579"}]},"ts":"1675782213579"} 2023-02-07 15:03:33,580 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:33,581 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:33,581 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782213581"}]},"ts":"1675782213581"} 2023-02-07 15:03:33,582 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-07 15:03:33,585 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:33,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:33,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:33,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:33,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2d35fd20f7683cc4175a8c55e3ed0cde, ASSIGN}] 2023-02-07 15:03:33,588 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2d35fd20f7683cc4175a8c55e3ed0cde, ASSIGN 2023-02-07 15:03:33,589 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2d35fd20f7683cc4175a8c55e3ed0cde, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41197,1675782212499; forceNewPlan=false, retain=false 2023-02-07 15:03:33,661 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:33,661 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:33,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:33,739 INFO [jenkins-hbase4:45051] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:33,739 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2d35fd20f7683cc4175a8c55e3ed0cde, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:33,739 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675782213739"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782213739"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782213739"}]},"ts":"1675782213739"} 2023-02-07 15:03:33,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2d35fd20f7683cc4175a8c55e3ed0cde, server=jenkins-hbase4.apache.org,41197,1675782212499}] 2023-02-07 15:03:33,797 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 15:03:33,835 INFO [RS:1;jenkins-hbase4:43919] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43919%2C1675782212524, suffix=, logDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,43919,1675782212524, archiveDir=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/oldWALs, maxLogs=32 2023-02-07 15:03:33,848 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK] 2023-02-07 15:03:33,848 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK] 2023-02-07 15:03:33,850 INFO [RS:1;jenkins-hbase4:43919] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/WALs/jenkins-hbase4.apache.org,43919,1675782212524/jenkins-hbase4.apache.org%2C43919%2C1675782212524.1675782213835 2023-02-07 15:03:33,851 DEBUG [RS:1;jenkins-hbase4:43919] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40389,DS-e4990f13-61d8-42bc-9ac3-c71063979678,DISK], DatanodeInfoWithStorage[127.0.0.1:36993,DS-fabc287f-438a-434f-b0d0-66622df38a0f,DISK]] 2023-02-07 15:03:33,863 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:33,863 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:33,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:33,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:33,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2d35fd20f7683cc4175a8c55e3ed0cde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:33,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:33,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,897 INFO [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,898 DEBUG [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1 2023-02-07 15:03:33,898 DEBUG [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1 2023-02-07 15:03:33,898 INFO [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d35fd20f7683cc4175a8c55e3ed0cde columnFamilyName f1 2023-02-07 15:03:33,899 INFO [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] regionserver.HStore(310): Store=2d35fd20f7683cc4175a8c55e3ed0cde/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:33,899 INFO [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,900 DEBUG [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2 2023-02-07 15:03:33,900 DEBUG [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2 2023-02-07 15:03:33,900 INFO [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d35fd20f7683cc4175a8c55e3ed0cde columnFamilyName f2 2023-02-07 15:03:33,900 INFO [StoreOpener-2d35fd20f7683cc4175a8c55e3ed0cde-1] regionserver.HStore(310): Store=2d35fd20f7683cc4175a8c55e3ed0cde/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:33,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:33,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:33,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:33,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2d35fd20f7683cc4175a8c55e3ed0cde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67465779, jitterRate=0.005318447947502136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:33,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2d35fd20f7683cc4175a8c55e3ed0cde: Running coprocessor pre-open hook at 1675782213896Writing region info on filesystem at 1675782213896Initializing all the Stores at 1675782213896Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782213896Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782213897 (+1 ms)Cleaning up temporary data from old regions at 1675782213902 (+5 ms)Cleaning up detritus from prior splits at 1675782213902Running coprocessor post-open hooks at 1675782213940 (+38 ms)Region opened successfully at 1675782213940 2023-02-07 15:03:33,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde., pid=12, masterSystemTime=1675782213893 2023-02-07 15:03:33,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:33,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:33,942 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2d35fd20f7683cc4175a8c55e3ed0cde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:33,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675782213942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782213942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782213942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782213942"}]},"ts":"1675782213942"} 2023-02-07 15:03:33,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 15:03:33,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2d35fd20f7683cc4175a8c55e3ed0cde, server=jenkins-hbase4.apache.org,41197,1675782212499 in 202 msec 2023-02-07 15:03:33,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 15:03:33,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2d35fd20f7683cc4175a8c55e3ed0cde, ASSIGN in 359 msec 2023-02-07 15:03:33,946 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:33,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782213946"}]},"ts":"1675782213946"} 2023-02-07 15:03:33,947 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-07 15:03:33,949 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:33,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 391 msec 2023-02-07 15:03:34,165 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,165 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:34,167 INFO [Listener at localhost/35155] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-07 15:03:34,167 DEBUG [Listener at localhost/35155] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-07 15:03:34,167 INFO [Listener at localhost/35155] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:34,169 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-07 15:03:34,169 INFO [Listener at localhost/35155] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:34,169 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-07 15:03:34,169 INFO [Listener at localhost/35155] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 15:03:34,181 DEBUG [hconnection-0x3e4647f1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:34,194 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46800, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:34,202 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,296 INFO [Listener at localhost/35155] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 15:03:34,296 INFO [Listener at localhost/35155] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 15:03:34,296 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,296 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 15:03:34,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675782214297 (current time:1675782214297). 2023-02-07 15:03:34,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 15:03:34,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] zookeeper.ReadOnlyZKClient(139): Connect 0x37c5f6aa to 127.0.0.1:61894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:34,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28543633, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:34,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:34,302 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:34,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37c5f6aa to 127.0.0.1:61894 2023-02-07 15:03:34,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:34,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 15:03:34,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 15:03:34,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 15:03:34,306 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 15:03:34,307 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675782814307 2023-02-07 15:03:34,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 15:03:34,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,309 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:34,309 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 15:03:34,309 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 15:03:34,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 15:03:34,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-07 15:03:34,311 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 15:03:34,311 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675782814311 2023-02-07 15:03:34,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-07 15:03:34,324 INFO [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-07 15:03:34,324 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:34,325 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-07 15:03:34,325 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-07 15:03:34,325 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,325 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:34,326 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:34,326 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:34,326 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 15:03:34,327 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,327 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 15:03:34,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-07 15:03:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:34,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-07 15:03:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-07 15:03:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:34,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-07 15:03:34,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 15:03:34,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 15:03:34,328 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 15:03:34,328 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 15:03:34,328 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:34,328 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 15:03:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 15:03:34,330 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 15:03:34,330 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 15:03:34,330 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41197,1675782212499' joining acquired barrier for procedure (foo) in zk 2023-02-07 15:03:34,330 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43919,1675782212524' joining acquired barrier for procedure (foo) in zk 2023-02-07 15:03:34,332 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,332 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:34,332 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,332 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,333 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:34,333 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,333 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:34,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41197,1675782212499' joining acquired barrier for procedure 'foo' on coordinator 2023-02-07 15:03:34,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@209937e6[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:34,334 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-07 15:03:34,334 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,335 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,335 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 15:03:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 15:03:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 15:03:34,335 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43919,1675782212524' in zk 2023-02-07 15:03:34,335 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 15:03:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:34,335 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,336 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. started... 2023-02-07 15:03:34,336 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2d35fd20f7683cc4175a8c55e3ed0cde 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 15:03:34,336 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 15:03:34,336 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:34,337 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 15:03:34,350 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f1/d55c2f105a90454a8e0bc734404bcad7 2023-02-07 15:03:34,368 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f2/5313f725cb3a48b9b02fd0a4df962260 2023-02-07 15:03:34,372 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f1/d55c2f105a90454a8e0bc734404bcad7 as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/d55c2f105a90454a8e0bc734404bcad7 2023-02-07 15:03:34,376 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/d55c2f105a90454a8e0bc734404bcad7, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:34,376 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f2/5313f725cb3a48b9b02fd0a4df962260 as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/5313f725cb3a48b9b02fd0a4df962260 2023-02-07 15:03:34,380 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/5313f725cb3a48b9b02fd0a4df962260, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:34,380 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2d35fd20f7683cc4175a8c55e3ed0cde in 44ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:34,380 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 15:03:34,381 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2d35fd20f7683cc4175a8c55e3ed0cde: 2023-02-07 15:03:34,381 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.' region-info for snapshot=foo 2023-02-07 15:03:34,381 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:34,381 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/d55c2f105a90454a8e0bc734404bcad7] hfiles 2023-02-07 15:03:34,381 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/d55c2f105a90454a8e0bc734404bcad7 for snapshot=foo 2023-02-07 15:03:34,381 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/5313f725cb3a48b9b02fd0a4df962260] hfiles 2023-02-07 15:03:34,381 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/5313f725cb3a48b9b02fd0a4df962260 for snapshot=foo 2023-02-07 15:03:34,387 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. completed. 2023-02-07 15:03:34,387 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 15:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 15:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 15:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41197,1675782212499' in zk 2023-02-07 15:03:34,389 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,389 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 15:03:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:34,389 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:34,389 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 15:03:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:34,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:34,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,41197,1675782212499': 2023-02-07 15:03:34,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41197,1675782212499' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-07 15:03:34,392 INFO [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-07 15:03:34,392 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:34,392 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:34,392 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-07 15:03:34,392 INFO [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 15:03:34,398 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,398 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:34,398 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:34,398 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,399 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:34,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:34,399 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:34,400 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,401 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:34,401 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 15:03:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,406 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:34,406 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:34,406 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:34,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:34,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-07 15:03:34,406 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:34,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-07 15:03:34,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:34,406 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:34,406 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 15:03:34,407 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 15:03:34,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.hbase-snapshot/.tmp/foo 2023-02-07 15:03:34,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:34,409 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:34,410 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,410 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-07 15:03:34,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:34,411 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 15:03:34,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.hbase-snapshot/.tmp/foo to hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.hbase-snapshot/foo 2023-02-07 15:03:34,438 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-07 15:03:34,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.hbase-snapshot/.tmp/foo 2023-02-07 15:03:34,438 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.hbase-snapshot/.tmp/foo 2023-02-07 15:03:34,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675782214307Consolidate snapshot: foo at 1675782214406 (+99 ms)Loading Region manifests for foo at 1675782214407 (+1 ms)Writing data manifest for foo at 1675782214409 (+2 ms)Verifying snapshot: foo at 1675782214418 (+9 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675782214438 (+20 ms) 2023-02-07 15:03:34,440 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 15:03:34,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 132 msec 2023-02-07 15:03:34,611 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:34,611 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,611 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-07 15:03:34,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 15:03:34,613 INFO [Listener at localhost/35155] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 15:03:34,613 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,613 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,617 INFO [Listener at localhost/35155] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 15:03:34,621 INFO [Listener at localhost/35155] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 15:03:34,650 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,735 INFO [Listener at localhost/35155] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 15:03:34,738 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,738 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 15:03:34,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,742 INFO [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 15:03:34,742 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:34,743 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-07 15:03:34,743 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-07 15:03:34,743 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,743 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,744 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:34,744 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:34,744 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:34,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:34,745 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,745 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,746 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-07 15:03:34,746 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:34,746 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-07 15:03:34,747 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-07 15:03:34,747 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:34,747 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-07 15:03:34,747 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-07 15:03:34,747 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43919,1675782212524' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-07 15:03:34,747 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 15:03:34,747 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:34,748 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,748 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. started... 2023-02-07 15:03:34,748 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2d35fd20f7683cc4175a8c55e3ed0cde 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 15:03:34,749 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,749 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,749 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:34,762 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f1/1ef29e971c8a4326844cf3499aff3848 2023-02-07 15:03:34,780 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f2/0bb82af4a4194a95b095e8c256a38b37 2023-02-07 15:03:34,784 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f1/1ef29e971c8a4326844cf3499aff3848 as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/1ef29e971c8a4326844cf3499aff3848 2023-02-07 15:03:34,787 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/1ef29e971c8a4326844cf3499aff3848, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:34,788 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/.tmp/f2/0bb82af4a4194a95b095e8c256a38b37 as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/0bb82af4a4194a95b095e8c256a38b37 2023-02-07 15:03:34,791 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/0bb82af4a4194a95b095e8c256a38b37, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:34,792 INFO [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2d35fd20f7683cc4175a8c55e3ed0cde in 44ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:34,793 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2d35fd20f7683cc4175a8c55e3ed0cde: 2023-02-07 15:03:34,793 DEBUG [rs(jenkins-hbase4.apache.org,41197,1675782212499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 15:03:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 15:03:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-07 15:03:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41197,1675782212499' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-07 15:03:34,795 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,795 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:34,795 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,795 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:34,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:34,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41197,1675782212499' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-07 15:03:34,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24a6a72d[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:34,797 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-07 15:03:34,797 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,799 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,799 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-07 15:03:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-07 15:03:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-07 15:03:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-07 15:03:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,41197,1675782212499' in zk 2023-02-07 15:03:34,799 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,799 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,43919,1675782212524' in zk 2023-02-07 15:03:34,800 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,800 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-07 15:03:34,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:34,800 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-07 15:03:34,800 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,43919,1675782212524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-07 15:03:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,41197,1675782212499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-07 15:03:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,41197,1675782212499': 2023-02-07 15:03:34,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41197,1675782212499' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-07 15:03:34,803 INFO [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-07 15:03:34,803 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:34,803 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:34,803 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,803 INFO [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 15:03:34,804 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,804 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:34,804 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,804 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,805 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:34,805 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,805 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,807 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:34,808 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,810 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,810 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:34,810 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,810 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:34,810 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:34,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:34,810 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:34,811 DEBUG [(jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:34,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 15:03:34,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 15:03:34,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:34,810 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:34,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:34,811 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:34,911 DEBUG [Listener at localhost/35155] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 15:03:34,912 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,912 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 15:03:34,917 INFO [Listener at localhost/35155] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675782214297 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:34,917 DEBUG [Listener at localhost/35155] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36999/user/jenkins/test-data/33cdf9d3-c527-b547-bbf5-0fab447bf49c/foo/68d4c2ac-a6f4-4162-853f-5458770657c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,918 INFO [Listener at localhost/35155] snapshot.RestoreSnapshotHelper(239): region to add: 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:34,918 INFO [Listener at localhost/35155] snapshot.RestoreSnapshotHelper(585): clone region=2d35fd20f7683cc4175a8c55e3ed0cde as 2d35fd20f7683cc4175a8c55e3ed0cde in snapshot foo 2023-02-07 15:03:34,918 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2d35fd20f7683cc4175a8c55e3ed0cde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36999/user/jenkins/test-data/33cdf9d3-c527-b547-bbf5-0fab447bf49c/foo/68d4c2ac-a6f4-4162-853f-5458770657c6 2023-02-07 15:03:34,927 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:34,928 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d55c2f105a90454a8e0bc734404bcad7 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,929 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5313f725cb3a48b9b02fd0a4df962260 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,931 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2d35fd20f7683cc4175a8c55e3ed0cde, disabling compactions & flushes 2023-02-07 15:03:34,931 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. after waiting 0 ms 2023-02-07 15:03:34,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,932 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:34,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2d35fd20f7683cc4175a8c55e3ed0cde: Waiting for close lock at 1675782214931Disabling compacts and flushes for region at 1675782214931Disabling writes for close at 1675782214932 (+1 ms)Writing region close event to WAL at 1675782214932Closed at 1675782214932 2023-02-07 15:03:34,934 INFO [Listener at localhost/35155] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675782214297 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:34,934 DEBUG [Listener at localhost/35155] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36999/user/jenkins/test-data/33cdf9d3-c527-b547-bbf5-0fab447bf49c/foo/68d4c2ac-a6f4-4162-853f-5458770657c6 2023-02-07 15:03:34,934 DEBUG [Listener at localhost/35155] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36999/user/jenkins/test-data/33cdf9d3-c527-b547-bbf5-0fab447bf49c/foo/68d4c2ac-a6f4-4162-853f-5458770657c6 2023-02-07 15:03:34,934 DEBUG [Listener at localhost/35155] util.CommonFSUtils(699): |-data/ 2023-02-07 15:03:34,934 DEBUG [Listener at localhost/35155] util.CommonFSUtils(699): |----default/ 2023-02-07 15:03:34,935 DEBUG [Listener at localhost/35155] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-07 15:03:34,935 DEBUG [Listener at localhost/35155] util.CommonFSUtils(699): |----------2d35fd20f7683cc4175a8c55e3ed0cde/ 2023-02-07 15:03:34,935 DEBUG [Listener at localhost/35155] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:34,935 DEBUG [Listener at localhost/35155] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:34,936 DEBUG [Listener at localhost/35155] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=2d35fd20f7683cc4175a8c55e3ed0cde-d55c2f105a90454a8e0bc734404bcad7 2023-02-07 15:03:34,936 DEBUG [Listener at localhost/35155] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:34,936 DEBUG [Listener at localhost/35155] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=2d35fd20f7683cc4175a8c55e3ed0cde-5313f725cb3a48b9b02fd0a4df962260 hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/1ef29e971c8a4326844cf3499aff3848 hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/d55c2f105a90454a8e0bc734404bcad7 hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/0bb82af4a4194a95b095e8c256a38b37 hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/5313f725cb3a48b9b02fd0a4df962260 2023-02-07 15:03:34,940 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,940 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-07 15:03:34,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-07 15:03:34,944 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,944 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,944 INFO [Listener at localhost/35155] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:34,948 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:34,948 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:34,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782214948"}]},"ts":"1675782214948"} 2023-02-07 15:03:34,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:34,950 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-07 15:03:34,952 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-07 15:03:34,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2d35fd20f7683cc4175a8c55e3ed0cde, UNASSIGN}] 2023-02-07 15:03:34,955 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2d35fd20f7683cc4175a8c55e3ed0cde, UNASSIGN 2023-02-07 15:03:34,955 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2d35fd20f7683cc4175a8c55e3ed0cde, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:34,955 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675782214955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782214955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782214955"}]},"ts":"1675782214955"} 2023-02-07 15:03:34,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2d35fd20f7683cc4175a8c55e3ed0cde, server=jenkins-hbase4.apache.org,41197,1675782212499}] 2023-02-07 15:03:35,050 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:35,050 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:35,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:35,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:35,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2d35fd20f7683cc4175a8c55e3ed0cde, disabling compactions & flushes 2023-02-07 15:03:35,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:35,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:35,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. after waiting 0 ms 2023-02-07 15:03:35,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:35,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:35,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde. 2023-02-07 15:03:35,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2d35fd20f7683cc4175a8c55e3ed0cde: Waiting for close lock at 1675782215109Running coprocessor pre-close hooks at 1675782215109Disabling compacts and flushes for region at 1675782215109Disabling writes for close at 1675782215109Writing region close event to WAL at 1675782215110 (+1 ms)Running coprocessor post-close hooks at 1675782215113 (+3 ms)Closed at 1675782215113 2023-02-07 15:03:35,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:35,114 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2d35fd20f7683cc4175a8c55e3ed0cde, regionState=CLOSED 2023-02-07 15:03:35,115 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675782215114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782215114"}]},"ts":"1675782215114"} 2023-02-07 15:03:35,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 15:03:35,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2d35fd20f7683cc4175a8c55e3ed0cde, server=jenkins-hbase4.apache.org,41197,1675782212499 in 159 msec 2023-02-07 15:03:35,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 15:03:35,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2d35fd20f7683cc4175a8c55e3ed0cde, UNASSIGN in 164 msec 2023-02-07 15:03:35,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782215119"}]},"ts":"1675782215119"} 2023-02-07 15:03:35,120 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-07 15:03:35,121 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-07 15:03:35,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 177 msec 2023-02-07 15:03:35,251 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:35,251 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:35,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:35,253 INFO [Listener at localhost/35155] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-07 15:03:35,253 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:35,253 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:35,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:35,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:35,256 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:35,256 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:35,256 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:35,256 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:35,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:35,259 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:35,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1, FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2, FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/recovered.edits] 2023-02-07 15:03:35,265 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/1ef29e971c8a4326844cf3499aff3848 to hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/1ef29e971c8a4326844cf3499aff3848 2023-02-07 15:03:35,266 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/d55c2f105a90454a8e0bc734404bcad7 to hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f1/d55c2f105a90454a8e0bc734404bcad7 2023-02-07 15:03:35,269 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/0bb82af4a4194a95b095e8c256a38b37 to hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/0bb82af4a4194a95b095e8c256a38b37 2023-02-07 15:03:35,271 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/5313f725cb3a48b9b02fd0a4df962260 to hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/f2/5313f725cb3a48b9b02fd0a4df962260 2023-02-07 15:03:35,273 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/recovered.edits/12.seqid to hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde/recovered.edits/12.seqid 2023-02-07 15:03:35,275 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2d35fd20f7683cc4175a8c55e3ed0cde 2023-02-07 15:03:35,275 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-07 15:03:35,278 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:35,279 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-07 15:03:35,281 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-07 15:03:35,285 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:35,285 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-07 15:03:35,286 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782215285"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:35,287 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 15:03:35,287 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2d35fd20f7683cc4175a8c55e3ed0cde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675782213557.2d35fd20f7683cc4175a8c55e3ed0cde.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 15:03:35,287 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-07 15:03:35,287 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675782215287"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:35,288 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-07 15:03:35,290 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 15:03:35,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 37 msec 2023-02-07 15:03:35,357 INFO [Listener at localhost/35155] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:35,358 INFO [Listener at localhost/35155] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:35,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:35,359 INFO [Listener at localhost/35155] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-07 15:03:35,359 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 15:03:35,359 INFO [Listener at localhost/35155] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 15:03:35,360 DEBUG [Listener at localhost/35155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c6003df to 127.0.0.1:61894 2023-02-07 15:03:35,360 DEBUG [Listener at localhost/35155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:35,360 DEBUG [Listener at localhost/35155] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 15:03:35,361 DEBUG [Listener at localhost/35155] util.JVMClusterUtil(257): Found active master hash=990552278, stopped=false 2023-02-07 15:03:35,361 INFO [Listener at localhost/35155] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:35,362 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:35,362 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:35,362 INFO [Listener at localhost/35155] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 15:03:35,362 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:35,362 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:35,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:35,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:35,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:35,366 DEBUG [Listener at localhost/35155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e64f3b0 to 127.0.0.1:61894 2023-02-07 15:03:35,366 DEBUG [Listener at localhost/35155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:35,367 INFO [Listener at localhost/35155] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41197,1675782212499' ***** 2023-02-07 15:03:35,367 INFO [Listener at localhost/35155] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:35,367 INFO [Listener at localhost/35155] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43919,1675782212524' ***** 2023-02-07 15:03:35,367 INFO [Listener at localhost/35155] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:35,367 INFO [RS:0;jenkins-hbase4:41197] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:35,367 INFO [RS:1;jenkins-hbase4:43919] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:35,367 INFO [RS:0;jenkins-hbase4:41197] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:35,367 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:35,367 INFO [RS:0;jenkins-hbase4:41197] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:35,367 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:35,367 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(3304): Received CLOSE for 4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:35,367 INFO [RS:1;jenkins-hbase4:43919] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:35,367 INFO [RS:1;jenkins-hbase4:43919] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:35,368 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:35,368 DEBUG [RS:1;jenkins-hbase4:43919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x507a496b to 127.0.0.1:61894 2023-02-07 15:03:35,367 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:35,369 DEBUG [RS:1;jenkins-hbase4:43919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:35,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d49d7deb9e6f0073e8922a6862fcd58, disabling compactions & flushes 2023-02-07 15:03:35,369 INFO [RS:1;jenkins-hbase4:43919] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:35,369 INFO [RS:1;jenkins-hbase4:43919] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:35,369 INFO [RS:1;jenkins-hbase4:43919] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:35,369 DEBUG [RS:0;jenkins-hbase4:41197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c8f7f2c to 127.0.0.1:61894 2023-02-07 15:03:35,369 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 15:03:35,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:35,369 DEBUG [RS:0;jenkins-hbase4:41197] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:35,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:35,369 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:35,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. after waiting 0 ms 2023-02-07 15:03:35,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:35,369 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1479): Online Regions={4d49d7deb9e6f0073e8922a6862fcd58=hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58.} 2023-02-07 15:03:35,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4d49d7deb9e6f0073e8922a6862fcd58 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 15:03:35,369 DEBUG [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1505): Waiting on 4d49d7deb9e6f0073e8922a6862fcd58 2023-02-07 15:03:35,372 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:35,372 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 15:03:35,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:35,372 DEBUG [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:35,372 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:35,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:35,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:35,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:35,372 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-07 15:03:35,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/.tmp/info/1920229545174a00973cea0d894d745d 2023-02-07 15:03:35,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/.tmp/info/1920229545174a00973cea0d894d745d as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/info/1920229545174a00973cea0d894d745d 2023-02-07 15:03:35,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/info/1920229545174a00973cea0d894d745d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 15:03:35,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4d49d7deb9e6f0073e8922a6862fcd58 in 29ms, sequenceid=6, compaction requested=false 2023-02-07 15:03:35,401 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:35,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/.tmp/info/d40f5083bbee454da6037b91c051cb6a 2023-02-07 15:03:35,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/namespace/4d49d7deb9e6f0073e8922a6862fcd58/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 15:03:35,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:35,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d49d7deb9e6f0073e8922a6862fcd58: Waiting for close lock at 1675782215367Running coprocessor pre-close hooks at 1675782215367Disabling compacts and flushes for region at 1675782215367Disabling writes for close at 1675782215369 (+2 ms)Obtaining lock to block concurrent updates at 1675782215369Preparing flush snapshotting stores in 4d49d7deb9e6f0073e8922a6862fcd58 at 1675782215369Finished memstore snapshotting hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675782215370 (+1 ms)Flushing stores of hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. at 1675782215370Flushing 4d49d7deb9e6f0073e8922a6862fcd58/info: creating writer at 1675782215370Flushing 4d49d7deb9e6f0073e8922a6862fcd58/info: appending metadata at 1675782215372 (+2 ms)Flushing 4d49d7deb9e6f0073e8922a6862fcd58/info: closing flushed file at 1675782215372Flushing 4d49d7deb9e6f0073e8922a6862fcd58/info: reopening flushed file at 1675782215393 (+21 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4d49d7deb9e6f0073e8922a6862fcd58 in 29ms, sequenceid=6, compaction requested=false at 1675782215398 (+5 ms)Writing region close event to WAL at 1675782215406 (+8 ms)Running coprocessor post-close hooks at 1675782215410 (+4 ms)Closed at 1675782215411 (+1 ms) 2023-02-07 15:03:35,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675782213060.4d49d7deb9e6f0073e8922a6862fcd58. 2023-02-07 15:03:35,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40f5083bbee454da6037b91c051cb6a 2023-02-07 15:03:35,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/.tmp/rep_barrier/7c1a05efa87b4627a58958ca15af914f 2023-02-07 15:03:35,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c1a05efa87b4627a58958ca15af914f 2023-02-07 15:03:35,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/.tmp/table/55a1516af5bf4158b6bb2a8d18b80561 2023-02-07 15:03:35,435 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:35,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55a1516af5bf4158b6bb2a8d18b80561 2023-02-07 15:03:35,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/.tmp/info/d40f5083bbee454da6037b91c051cb6a as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/info/d40f5083bbee454da6037b91c051cb6a 2023-02-07 15:03:35,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40f5083bbee454da6037b91c051cb6a 2023-02-07 15:03:35,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/info/d40f5083bbee454da6037b91c051cb6a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 15:03:35,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/.tmp/rep_barrier/7c1a05efa87b4627a58958ca15af914f as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/rep_barrier/7c1a05efa87b4627a58958ca15af914f 2023-02-07 15:03:35,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c1a05efa87b4627a58958ca15af914f 2023-02-07 15:03:35,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/rep_barrier/7c1a05efa87b4627a58958ca15af914f, entries=1, sequenceid=21, filesize=5.1 K 2023-02-07 15:03:35,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/.tmp/table/55a1516af5bf4158b6bb2a8d18b80561 as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/table/55a1516af5bf4158b6bb2a8d18b80561 2023-02-07 15:03:35,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55a1516af5bf4158b6bb2a8d18b80561 2023-02-07 15:03:35,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/table/55a1516af5bf4158b6bb2a8d18b80561, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 15:03:35,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 83ms, sequenceid=21, compaction requested=false 2023-02-07 15:03:35,458 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 15:03:35,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:35,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:35,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782215372Running coprocessor pre-close hooks at 1675782215372Disabling compacts and flushes for region at 1675782215372Disabling writes for close at 1675782215372Obtaining lock to block concurrent updates at 1675782215372Preparing flush snapshotting stores in 1588230740 at 1675782215372Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675782215372Flushing stores of hbase:meta,,1.1588230740 at 1675782215373 (+1 ms)Flushing 1588230740/info: creating writer at 1675782215373Flushing 1588230740/info: appending metadata at 1675782215375 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675782215376 (+1 ms)Flushing 1588230740/rep_barrier: creating writer at 1675782215414 (+38 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675782215418 (+4 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675782215418Flushing 1588230740/table: creating writer at 1675782215427 (+9 ms)Flushing 1588230740/table: appending metadata at 1675782215429 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675782215429Flushing 1588230740/info: reopening flushed file at 1675782215441 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675782215445 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675782215450 (+5 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 83ms, sequenceid=21, compaction requested=false at 1675782215455 (+5 ms)Writing region close event to WAL at 1675782215456 (+1 ms)Running coprocessor post-close hooks at 1675782215459 (+3 ms)Closed at 1675782215460 (+1 ms) 2023-02-07 15:03:35,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:35,569 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41197,1675782212499; all regions closed. 2023-02-07 15:03:35,572 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43919,1675782212524; all regions closed. 2023-02-07 15:03:35,575 DEBUG [RS:0;jenkins-hbase4:41197] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/oldWALs 2023-02-07 15:03:35,575 INFO [RS:0;jenkins-hbase4:41197] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41197%2C1675782212499:(num 1675782213404) 2023-02-07 15:03:35,575 DEBUG [RS:0;jenkins-hbase4:41197] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:35,575 INFO [RS:0;jenkins-hbase4:41197] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:35,575 INFO [RS:0;jenkins-hbase4:41197] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:35,575 INFO [RS:0;jenkins-hbase4:41197] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:35,575 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:35,575 INFO [RS:0;jenkins-hbase4:41197] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:35,576 INFO [RS:0;jenkins-hbase4:41197] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:35,577 INFO [RS:0;jenkins-hbase4:41197] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41197 2023-02-07 15:03:35,578 DEBUG [RS:1;jenkins-hbase4:43919] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/oldWALs 2023-02-07 15:03:35,578 INFO [RS:1;jenkins-hbase4:43919] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43919%2C1675782212524.meta:.meta(num 1675782213012) 2023-02-07 15:03:35,579 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:35,579 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:35,580 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:35,580 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41197,1675782212499 2023-02-07 15:03:35,580 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e6de2a1 rejected from java.util.concurrent.ThreadPoolExecutor@2a5273b4[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:35,580 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:35,580 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f4ca18c rejected from java.util.concurrent.ThreadPoolExecutor@2a5273b4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:35,581 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41197,1675782212499] 2023-02-07 15:03:35,581 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41197,1675782212499; numProcessing=1 2023-02-07 15:03:35,582 DEBUG [RS:1;jenkins-hbase4:43919] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/oldWALs 2023-02-07 15:03:35,582 INFO [RS:1;jenkins-hbase4:43919] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43919%2C1675782212524:(num 1675782213835) 2023-02-07 15:03:35,582 DEBUG [RS:1;jenkins-hbase4:43919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:35,582 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41197,1675782212499 already deleted, retry=false 2023-02-07 15:03:35,582 INFO [RS:1;jenkins-hbase4:43919] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:35,582 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41197,1675782212499 expired; onlineServers=1 2023-02-07 15:03:35,582 INFO [RS:1;jenkins-hbase4:43919] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:35,582 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:35,584 INFO [RS:1;jenkins-hbase4:43919] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43919 2023-02-07 15:03:35,585 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:35,585 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43919,1675782212524 2023-02-07 15:03:35,585 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27338959 rejected from java.util.concurrent.ThreadPoolExecutor@230c0967[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:35,585 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43919,1675782212524] 2023-02-07 15:03:35,585 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43919,1675782212524; numProcessing=2 2023-02-07 15:03:35,587 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43919,1675782212524 already deleted, retry=false 2023-02-07 15:03:35,587 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43919,1675782212524 expired; onlineServers=0 2023-02-07 15:03:35,587 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45051,1675782212448' ***** 2023-02-07 15:03:35,587 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 15:03:35,588 DEBUG [M:0;jenkins-hbase4:45051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f35336f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:35,588 INFO [M:0;jenkins-hbase4:45051] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45051,1675782212448 2023-02-07 15:03:35,588 INFO [M:0;jenkins-hbase4:45051] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45051,1675782212448; all regions closed. 2023-02-07 15:03:35,588 DEBUG [M:0;jenkins-hbase4:45051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:35,588 DEBUG [M:0;jenkins-hbase4:45051] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 15:03:35,588 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 15:03:35,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782212664] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782212664,5,FailOnTimeoutGroup] 2023-02-07 15:03:35,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782212664] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782212664,5,FailOnTimeoutGroup] 2023-02-07 15:03:35,588 DEBUG [M:0;jenkins-hbase4:45051] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 15:03:35,590 INFO [M:0;jenkins-hbase4:45051] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 15:03:35,590 INFO [M:0;jenkins-hbase4:45051] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 15:03:35,590 INFO [M:0;jenkins-hbase4:45051] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 15:03:35,590 DEBUG [M:0;jenkins-hbase4:45051] master.HMaster(1502): Stopping service threads 2023-02-07 15:03:35,590 INFO [M:0;jenkins-hbase4:45051] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 15:03:35,591 ERROR [M:0;jenkins-hbase4:45051] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 15:03:35,591 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:35,591 INFO [M:0;jenkins-hbase4:45051] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 15:03:35,591 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:35,591 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 15:03:35,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:35,591 DEBUG [M:0;jenkins-hbase4:45051] zookeeper.ZKUtil(398): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 15:03:35,592 WARN [M:0;jenkins-hbase4:45051] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 15:03:35,592 INFO [M:0;jenkins-hbase4:45051] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 15:03:35,592 INFO [M:0;jenkins-hbase4:45051] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 15:03:35,592 DEBUG [M:0;jenkins-hbase4:45051] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:35,592 INFO [M:0;jenkins-hbase4:45051] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:35,592 DEBUG [M:0;jenkins-hbase4:45051] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:35,593 DEBUG [M:0;jenkins-hbase4:45051] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:35,593 DEBUG [M:0;jenkins-hbase4:45051] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:35,593 INFO [M:0;jenkins-hbase4:45051] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.67 KB 2023-02-07 15:03:35,603 INFO [M:0;jenkins-hbase4:45051] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a2ad5fb893ca45388bf561948d0aff92 2023-02-07 15:03:35,607 DEBUG [M:0;jenkins-hbase4:45051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a2ad5fb893ca45388bf561948d0aff92 as hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a2ad5fb893ca45388bf561948d0aff92 2023-02-07 15:03:35,611 INFO [M:0;jenkins-hbase4:45051] regionserver.HStore(1080): Added hdfs://localhost:36999/user/jenkins/test-data/6976c4f8-c999-b597-5a5d-68b8ab5a6556/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a2ad5fb893ca45388bf561948d0aff92, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 15:03:35,611 INFO [M:0;jenkins-hbase4:45051] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58039, heapSize ~67.66 KB/69280, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-07 15:03:35,612 INFO [M:0;jenkins-hbase4:45051] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:35,612 DEBUG [M:0;jenkins-hbase4:45051] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782215592Disabling compacts and flushes for region at 1675782215592Disabling writes for close at 1675782215593 (+1 ms)Obtaining lock to block concurrent updates at 1675782215593Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675782215593Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58039, getHeapSize=69280, getOffHeapSize=0, getCellsCount=145 at 1675782215593Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675782215594 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675782215594Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675782215596 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675782215596Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675782215608 (+12 ms)Finished flush of dataSize ~56.68 KB/58039, heapSize ~67.66 KB/69280, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675782215612 (+4 ms)Writing region close event to WAL at 1675782215612Closed at 1675782215612 2023-02-07 15:03:35,614 INFO [M:0;jenkins-hbase4:45051] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 15:03:35,614 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:35,616 INFO [M:0;jenkins-hbase4:45051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45051 2023-02-07 15:03:35,617 DEBUG [M:0;jenkins-hbase4:45051] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45051,1675782212448 already deleted, retry=false 2023-02-07 15:03:35,863 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:35,863 INFO [M:0;jenkins-hbase4:45051] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45051,1675782212448; zookeeper connection closed. 2023-02-07 15:03:35,864 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70ab64cb rejected from java.util.concurrent.ThreadPoolExecutor@7494ee06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:35,865 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): master:45051-0x1002f4f35110000, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:35,865 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b4b1a81 rejected from java.util.concurrent.ThreadPoolExecutor@7494ee06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:35,964 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:35,964 INFO [RS:1;jenkins-hbase4:43919] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43919,1675782212524; zookeeper connection closed. 2023-02-07 15:03:35,964 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ce0b16e rejected from java.util.concurrent.ThreadPoolExecutor@230c0967[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:35,964 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:43919-0x1002f4f35110002, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:35,964 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1426e858 rejected from java.util.concurrent.ThreadPoolExecutor@230c0967[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:35,964 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2cb4f030] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2cb4f030 2023-02-07 15:03:36,064 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:36,064 INFO [RS:0;jenkins-hbase4:41197] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41197,1675782212499; zookeeper connection closed. 2023-02-07 15:03:36,064 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67033797 rejected from java.util.concurrent.ThreadPoolExecutor@2a5273b4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:36,064 DEBUG [Listener at localhost/35155-EventThread] zookeeper.ZKWatcher(600): regionserver:41197-0x1002f4f35110001, quorum=127.0.0.1:61894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:36,064 ERROR [Listener at localhost/35155-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@75c59777 rejected from java.util.concurrent.ThreadPoolExecutor@2a5273b4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:36,064 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f4d43bc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f4d43bc 2023-02-07 15:03:36,064 INFO [Listener at localhost/35155] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 15:03:36,065 WARN [Listener at localhost/35155] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:36,068 INFO [Listener at localhost/35155] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:36,169 WARN [BP-743982929-172.31.14.131-1675782211876 heartbeating to localhost/127.0.0.1:36999] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:36,172 WARN [BP-743982929-172.31.14.131-1675782211876 heartbeating to localhost/127.0.0.1:36999] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-743982929-172.31.14.131-1675782211876 (Datanode Uuid 86815d26-9ec0-4fe7-a5bb-543e78375b9e) service to localhost/127.0.0.1:36999 2023-02-07 15:03:36,173 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4/dfs/data/data3/current/BP-743982929-172.31.14.131-1675782211876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:36,174 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4/dfs/data/data4/current/BP-743982929-172.31.14.131-1675782211876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:36,175 WARN [Listener at localhost/35155] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:36,181 INFO [Listener at localhost/35155] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:36,287 WARN [BP-743982929-172.31.14.131-1675782211876 heartbeating to localhost/127.0.0.1:36999] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:36,287 WARN [BP-743982929-172.31.14.131-1675782211876 heartbeating to localhost/127.0.0.1:36999] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-743982929-172.31.14.131-1675782211876 (Datanode Uuid d39488b0-1baa-40a8-ab63-86fe96148a7d) service to localhost/127.0.0.1:36999 2023-02-07 15:03:36,288 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4/dfs/data/data1/current/BP-743982929-172.31.14.131-1675782211876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:36,288 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/cluster_ee5a9a67-a107-cfa2-b9b6-8c4d37b709e4/dfs/data/data2/current/BP-743982929-172.31.14.131-1675782211876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:36,296 INFO [Listener at localhost/35155] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:36,409 INFO [Listener at localhost/35155] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 15:03:36,431 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 15:03:36,444 INFO [Listener at localhost/35155] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=276 (was 255) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35155 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:36999 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:36999 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:36999 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45051,1675782212448)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:36999 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:36999 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36999 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:36999 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=577 (was 666), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 291), ProcessCount=166 (was 166), AvailableMemoryMB=5406 (was 5439) 2023-02-07 15:03:36,454 INFO [Listener at localhost/35155] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=276, OpenFileDescriptor=577, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=166, AvailableMemoryMB=5405 2023-02-07 15:03:36,464 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/hadoop.log.dir so I do NOT create it in target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2 2023-02-07 15:03:36,464 WARN [Listener at localhost/35155] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 15:03:36,464 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/hadoop.tmp.dir so I do NOT create it in target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2 2023-02-07 15:03:36,464 WARN [Listener at localhost/35155] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c675766d-280b-647c-0885-45a110834937/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 15:03:36,464 DEBUG [Listener at localhost/35155] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2 2023-02-07 15:03:36,464 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3, deleteOnExit=true 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/test.cache.data in system properties and HBase conf 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/hadoop.log.dir in system properties and HBase conf 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 15:03:36,465 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 15:03:36,465 DEBUG [Listener at localhost/35155] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/nfs.dump.dir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/java.io.tmpdir in system properties and HBase conf 2023-02-07 15:03:36,466 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 15:03:36,467 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 15:03:36,467 INFO [Listener at localhost/35155] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 15:03:36,471 WARN [Listener at localhost/35155] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:36,471 WARN [Listener at localhost/35155] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:36,522 WARN [Listener at localhost/35155] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:36,524 INFO [Listener at localhost/35155] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:36,529 INFO [Listener at localhost/35155] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/java.io.tmpdir/Jetty_localhost_46445_hdfs____.avkuar/webapp 2023-02-07 15:03:36,627 INFO [Listener at localhost/35155] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46445 2023-02-07 15:03:36,632 WARN [Listener at localhost/35155] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 15:03:36,632 WARN [Listener at localhost/35155] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 15:03:36,670 WARN [Listener at localhost/34759] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:36,691 WARN [Listener at localhost/34759] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:36,693 WARN [Listener at localhost/34759] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:36,694 INFO [Listener at localhost/34759] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:36,701 INFO [Listener at localhost/34759] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/java.io.tmpdir/Jetty_localhost_40357_datanode____c5x9j4/webapp 2023-02-07 15:03:36,792 INFO [Listener at localhost/34759] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40357 2023-02-07 15:03:36,800 WARN [Listener at localhost/43091] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:36,815 WARN [Listener at localhost/43091] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 15:03:36,816 WARN [Listener at localhost/43091] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 15:03:36,817 INFO [Listener at localhost/43091] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 15:03:36,820 INFO [Listener at localhost/43091] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/java.io.tmpdir/Jetty_localhost_44159_datanode____.a5a6is/webapp 2023-02-07 15:03:36,895 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18731eb20592bf10: Processing first storage report for DS-8e97f96a-2822-48ed-91cc-733cea45c45f from datanode d1ba005f-ad94-4c24-adbb-e3b391345e26 2023-02-07 15:03:36,895 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18731eb20592bf10: from storage DS-8e97f96a-2822-48ed-91cc-733cea45c45f node DatanodeRegistration(127.0.0.1:35789, datanodeUuid=d1ba005f-ad94-4c24-adbb-e3b391345e26, infoPort=33765, infoSecurePort=0, ipcPort=43091, storageInfo=lv=-57;cid=testClusterID;nsid=849394319;c=1675782216473), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 15:03:36,895 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18731eb20592bf10: Processing first storage report for DS-92de1ace-33f8-46c7-89f2-be83f02b47e5 from datanode d1ba005f-ad94-4c24-adbb-e3b391345e26 2023-02-07 15:03:36,895 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18731eb20592bf10: from storage DS-92de1ace-33f8-46c7-89f2-be83f02b47e5 node DatanodeRegistration(127.0.0.1:35789, datanodeUuid=d1ba005f-ad94-4c24-adbb-e3b391345e26, infoPort=33765, infoSecurePort=0, ipcPort=43091, storageInfo=lv=-57;cid=testClusterID;nsid=849394319;c=1675782216473), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:36,928 INFO [Listener at localhost/43091] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44159 2023-02-07 15:03:36,935 WARN [Listener at localhost/40391] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 15:03:37,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb0a01d6a62e091b0: Processing first storage report for DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9 from datanode b5899a17-cf53-4515-881b-c2889398edbc 2023-02-07 15:03:37,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb0a01d6a62e091b0: from storage DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9 node DatanodeRegistration(127.0.0.1:41717, datanodeUuid=b5899a17-cf53-4515-881b-c2889398edbc, infoPort=43071, infoSecurePort=0, ipcPort=40391, storageInfo=lv=-57;cid=testClusterID;nsid=849394319;c=1675782216473), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:37,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb0a01d6a62e091b0: Processing first storage report for DS-41da317b-0645-4e0d-b37a-32a2e500b82b from datanode b5899a17-cf53-4515-881b-c2889398edbc 2023-02-07 15:03:37,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb0a01d6a62e091b0: from storage DS-41da317b-0645-4e0d-b37a-32a2e500b82b node DatanodeRegistration(127.0.0.1:41717, datanodeUuid=b5899a17-cf53-4515-881b-c2889398edbc, infoPort=43071, infoSecurePort=0, ipcPort=40391, storageInfo=lv=-57;cid=testClusterID;nsid=849394319;c=1675782216473), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 15:03:37,044 DEBUG [Listener at localhost/40391] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2 2023-02-07 15:03:37,048 INFO [Listener at localhost/40391] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3/zookeeper_0, clientPort=55291, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 15:03:37,052 INFO [Listener at localhost/40391] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55291 2023-02-07 15:03:37,052 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,053 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,065 INFO [Listener at localhost/40391] util.FSUtils(479): Created version file at hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e with version=8 2023-02-07 15:03:37,066 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,066 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,067 INFO [Listener at localhost/40391] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/hbase-staging 2023-02-07 15:03:37,069 INFO [Listener at localhost/40391] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:37,069 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,069 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,069 INFO [Listener at localhost/40391] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:37,069 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,069 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:37,069 INFO [Listener at localhost/40391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:37,070 INFO [Listener at localhost/40391] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39629 2023-02-07 15:03:37,070 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,071 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,072 INFO [Listener at localhost/40391] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39629 connecting to ZooKeeper ensemble=127.0.0.1:55291 2023-02-07 15:03:37,080 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:396290x0, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:37,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39629-0x1002f4f471a0000 connected 2023-02-07 15:03:37,102 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:37,102 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:37,103 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:37,108 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39629 2023-02-07 15:03:37,108 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39629 2023-02-07 15:03:37,108 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39629 2023-02-07 15:03:37,109 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39629 2023-02-07 15:03:37,109 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39629 2023-02-07 15:03:37,109 INFO [Listener at localhost/40391] master.HMaster(439): hbase.rootdir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e, hbase.cluster.distributed=false 2023-02-07 15:03:37,121 INFO [Listener at localhost/40391] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:37,121 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,121 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,121 INFO [Listener at localhost/40391] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:37,121 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,121 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:37,121 INFO [Listener at localhost/40391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:37,124 INFO [Listener at localhost/40391] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32965 2023-02-07 15:03:37,124 INFO [Listener at localhost/40391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:37,128 DEBUG [Listener at localhost/40391] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:37,128 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,129 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,130 INFO [Listener at localhost/40391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32965 connecting to ZooKeeper ensemble=127.0.0.1:55291 2023-02-07 15:03:37,132 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:329650x0, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:37,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32965-0x1002f4f471a0001 connected 2023-02-07 15:03:37,134 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:37,135 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:37,136 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:37,140 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32965 2023-02-07 15:03:37,140 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32965 2023-02-07 15:03:37,140 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32965 2023-02-07 15:03:37,144 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32965 2023-02-07 15:03:37,144 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32965 2023-02-07 15:03:37,155 INFO [Listener at localhost/40391] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 15:03:37,155 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,155 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,155 INFO [Listener at localhost/40391] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 15:03:37,155 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 15:03:37,155 INFO [Listener at localhost/40391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 15:03:37,155 INFO [Listener at localhost/40391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 15:03:37,156 INFO [Listener at localhost/40391] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33459 2023-02-07 15:03:37,156 INFO [Listener at localhost/40391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 15:03:37,158 DEBUG [Listener at localhost/40391] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:37,159 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,160 INFO [Listener at localhost/40391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,160 INFO [Listener at localhost/40391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33459 connecting to ZooKeeper ensemble=127.0.0.1:55291 2023-02-07 15:03:37,164 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:334590x0, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 15:03:37,164 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): regionserver:334590x0, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:37,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33459-0x1002f4f471a0002 connected 2023-02-07 15:03:37,165 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:37,166 DEBUG [Listener at localhost/40391] zookeeper.ZKUtil(164): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 15:03:37,170 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33459 2023-02-07 15:03:37,171 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33459 2023-02-07 15:03:37,172 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33459 2023-02-07 15:03:37,172 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33459 2023-02-07 15:03:37,172 DEBUG [Listener at localhost/40391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33459 2023-02-07 15:03:37,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:37,175 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:37,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:37,181 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:37,181 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:37,181 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:37,183 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:37,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:37,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 15:03:37,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39629,1675782217069 from backup master directory 2023-02-07 15:03:37,186 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:37,186 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 15:03:37,186 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:37,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:37,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/hbase.id with ID: 2198c4fc-ca25-424c-8f3f-b338973cb429 2023-02-07 15:03:37,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 15:03:37,213 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:37,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6707f5ce to 127.0.0.1:55291 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:37,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@393bb993, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:37,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:37,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 15:03:37,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:37,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store-tmp 2023-02-07 15:03:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:37,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:37,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782217235Disabling compacts and flushes for region at 1675782217235Disabling writes for close at 1675782217235Writing region close event to WAL at 1675782217235Closed at 1675782217235 2023-02-07 15:03:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/WALs/jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:37,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39629%2C1675782217069, suffix=, logDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/WALs/jenkins-hbase4.apache.org,39629,1675782217069, archiveDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/oldWALs, maxLogs=10 2023-02-07 15:03:37,255 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK] 2023-02-07 15:03:37,256 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK] 2023-02-07 15:03:37,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/WALs/jenkins-hbase4.apache.org,39629,1675782217069/jenkins-hbase4.apache.org%2C39629%2C1675782217069.1675782217238 2023-02-07 15:03:37,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK], DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK]] 2023-02-07 15:03:37,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:37,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:37,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:37,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:37,260 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:37,261 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 15:03:37,261 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 15:03:37,262 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:37,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:37,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:37,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 15:03:37,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:37,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60416104, jitterRate=-0.09972989559173584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:37,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675782217258Initializing all the Stores at 1675782217259 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782217259Cleaning up temporary data from old regions at 1675782217263 (+4 ms)Cleaning up detritus from prior splits at 1675782217263Region opened successfully at 1675782217269 (+6 ms) 2023-02-07 15:03:37,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 15:03:37,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 15:03:37,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 15:03:37,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 15:03:37,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 15:03:37,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 15:03:37,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 15:03:37,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 15:03:37,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 15:03:37,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 15:03:37,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 15:03:37,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 15:03:37,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 15:03:37,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 15:03:37,286 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:37,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 15:03:37,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 15:03:37,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 15:03:37,289 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:37,289 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:37,289 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:37,289 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:37,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39629,1675782217069, sessionid=0x1002f4f471a0000, setting cluster-up flag (Was=false) 2023-02-07 15:03:37,294 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:37,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 15:03:37,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:37,302 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:37,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 15:03:37,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:37,306 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.hbase-snapshot/.tmp 2023-02-07 15:03:37,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675782247312 2023-02-07 15:03:37,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 15:03:37,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 15:03:37,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 15:03:37,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 15:03:37,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 15:03:37,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 15:03:37,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,314 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:37,314 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 15:03:37,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 15:03:37,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 15:03:37,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 15:03:37,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 15:03:37,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 15:03:37,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782217315,5,FailOnTimeoutGroup] 2023-02-07 15:03:37,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782217315,5,FailOnTimeoutGroup] 2023-02-07 15:03:37,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 15:03:37,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,316 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:37,327 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:37,328 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:37,328 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e 2023-02-07 15:03:37,338 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:37,339 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:37,340 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/info 2023-02-07 15:03:37,340 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:37,341 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:37,341 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:37,342 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:37,342 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:37,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:37,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:37,344 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/table 2023-02-07 15:03:37,344 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:37,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:37,345 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740 2023-02-07 15:03:37,345 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740 2023-02-07 15:03:37,347 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:37,348 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:37,349 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:37,349 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69828646, jitterRate=0.040527909994125366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:37,349 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675782217338Initializing all the Stores at 1675782217339 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782217339Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782217339Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782217339Cleaning up temporary data from old regions at 1675782217346 (+7 ms)Cleaning up detritus from prior splits at 1675782217346Region opened successfully at 1675782217349 (+3 ms) 2023-02-07 15:03:37,349 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:37,350 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:37,350 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:37,350 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:37,350 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:37,350 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:37,350 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782217349Disabling compacts and flushes for region at 1675782217349Disabling writes for close at 1675782217350 (+1 ms)Writing region close event to WAL at 1675782217350Closed at 1675782217350 2023-02-07 15:03:37,351 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 15:03:37,351 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 15:03:37,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 15:03:37,355 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 15:03:37,356 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 15:03:37,374 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(952): ClusterId : 2198c4fc-ca25-424c-8f3f-b338973cb429 2023-02-07 15:03:37,374 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(952): ClusterId : 2198c4fc-ca25-424c-8f3f-b338973cb429 2023-02-07 15:03:37,374 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:37,374 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 15:03:37,378 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:37,378 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:37,378 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 15:03:37,378 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 15:03:37,380 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:37,381 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 15:03:37,381 DEBUG [RS:0;jenkins-hbase4:32965] zookeeper.ReadOnlyZKClient(139): Connect 0x472ca757 to 127.0.0.1:55291 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:37,382 DEBUG [RS:1;jenkins-hbase4:33459] zookeeper.ReadOnlyZKClient(139): Connect 0x4abe4176 to 127.0.0.1:55291 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:37,384 DEBUG [RS:0;jenkins-hbase4:32965] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49eb41c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:37,384 DEBUG [RS:1;jenkins-hbase4:33459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4479b651, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:37,384 DEBUG [RS:0;jenkins-hbase4:32965] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dd4cc27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:37,384 DEBUG [RS:1;jenkins-hbase4:33459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40462a06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:37,393 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32965 2023-02-07 15:03:37,393 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33459 2023-02-07 15:03:37,393 INFO [RS:0;jenkins-hbase4:32965] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:37,393 INFO [RS:0;jenkins-hbase4:32965] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:37,393 INFO [RS:1;jenkins-hbase4:33459] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 15:03:37,393 INFO [RS:1;jenkins-hbase4:33459] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 15:03:37,393 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:37,393 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 15:03:37,394 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39629,1675782217069 with isa=jenkins-hbase4.apache.org/172.31.14.131:32965, startcode=1675782217120 2023-02-07 15:03:37,394 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39629,1675782217069 with isa=jenkins-hbase4.apache.org/172.31.14.131:33459, startcode=1675782217154 2023-02-07 15:03:37,394 DEBUG [RS:1;jenkins-hbase4:33459] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:37,394 DEBUG [RS:0;jenkins-hbase4:32965] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 15:03:37,395 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50851, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:37,395 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41631, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 15:03:37,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39629] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,398 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e 2023-02-07 15:03:37,399 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34759 2023-02-07 15:03:37,399 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:37,399 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e 2023-02-07 15:03:37,399 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34759 2023-02-07 15:03:37,399 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 15:03:37,406 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:37,409 DEBUG [RS:1;jenkins-hbase4:33459] zookeeper.ZKUtil(162): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,409 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32965,1675782217120] 2023-02-07 15:03:37,409 WARN [RS:1;jenkins-hbase4:33459] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:37,409 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33459,1675782217154] 2023-02-07 15:03:37,409 DEBUG [RS:0;jenkins-hbase4:32965] zookeeper.ZKUtil(162): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,409 INFO [RS:1;jenkins-hbase4:33459] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:37,409 WARN [RS:0;jenkins-hbase4:32965] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 15:03:37,409 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,409 INFO [RS:0;jenkins-hbase4:32965] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:37,410 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,416 DEBUG [RS:1;jenkins-hbase4:33459] zookeeper.ZKUtil(162): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,417 DEBUG [RS:0;jenkins-hbase4:32965] zookeeper.ZKUtil(162): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,417 DEBUG [RS:1;jenkins-hbase4:33459] zookeeper.ZKUtil(162): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,417 DEBUG [RS:0;jenkins-hbase4:32965] zookeeper.ZKUtil(162): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,418 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:37,418 INFO [RS:1;jenkins-hbase4:33459] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:37,418 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 15:03:37,419 INFO [RS:0;jenkins-hbase4:32965] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 15:03:37,419 INFO [RS:1;jenkins-hbase4:33459] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:37,419 INFO [RS:1;jenkins-hbase4:33459] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:37,419 INFO [RS:1;jenkins-hbase4:33459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,419 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:37,421 INFO [RS:0;jenkins-hbase4:32965] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 15:03:37,423 INFO [RS:1;jenkins-hbase4:33459] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,423 INFO [RS:0;jenkins-hbase4:32965] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 15:03:37,423 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,423 INFO [RS:0;jenkins-hbase4:32965] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,423 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,423 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,423 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,423 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,423 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 15:03:37,423 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:37,424 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,424 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,424 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,424 DEBUG [RS:1;jenkins-hbase4:33459] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,424 INFO [RS:1;jenkins-hbase4:33459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,425 INFO [RS:0;jenkins-hbase4:32965] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,425 INFO [RS:1;jenkins-hbase4:33459] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 INFO [RS:1;jenkins-hbase4:33459] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,425 DEBUG [RS:0;jenkins-hbase4:32965] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 15:03:37,430 INFO [RS:0;jenkins-hbase4:32965] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,430 INFO [RS:0;jenkins-hbase4:32965] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,431 INFO [RS:0;jenkins-hbase4:32965] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,442 INFO [RS:1;jenkins-hbase4:33459] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:37,442 INFO [RS:1;jenkins-hbase4:33459] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33459,1675782217154-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,445 INFO [RS:0;jenkins-hbase4:32965] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 15:03:37,445 INFO [RS:0;jenkins-hbase4:32965] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32965,1675782217120-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,455 INFO [RS:1;jenkins-hbase4:33459] regionserver.Replication(203): jenkins-hbase4.apache.org,33459,1675782217154 started 2023-02-07 15:03:37,455 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33459,1675782217154, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33459, sessionid=0x1002f4f471a0002 2023-02-07 15:03:37,455 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:37,455 DEBUG [RS:1;jenkins-hbase4:33459] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,455 DEBUG [RS:1;jenkins-hbase4:33459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33459,1675782217154' 2023-02-07 15:03:37,456 DEBUG [RS:1;jenkins-hbase4:33459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:37,456 DEBUG [RS:1;jenkins-hbase4:33459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:37,456 INFO [RS:0;jenkins-hbase4:32965] regionserver.Replication(203): jenkins-hbase4.apache.org,32965,1675782217120 started 2023-02-07 15:03:37,456 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32965,1675782217120, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32965, sessionid=0x1002f4f471a0001 2023-02-07 15:03:37,456 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:37,456 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 15:03:37,456 DEBUG [RS:0;jenkins-hbase4:32965] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,456 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:37,456 DEBUG [RS:0;jenkins-hbase4:32965] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32965,1675782217120' 2023-02-07 15:03:37,457 DEBUG [RS:0;jenkins-hbase4:32965] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:37,457 DEBUG [RS:1;jenkins-hbase4:33459] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,457 DEBUG [RS:1;jenkins-hbase4:33459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33459,1675782217154' 2023-02-07 15:03:37,457 DEBUG [RS:1;jenkins-hbase4:33459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:37,457 DEBUG [RS:1;jenkins-hbase4:33459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:37,457 DEBUG [RS:0;jenkins-hbase4:32965] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:37,457 DEBUG [RS:1;jenkins-hbase4:33459] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:37,457 INFO [RS:1;jenkins-hbase4:33459] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:37,457 INFO [RS:1;jenkins-hbase4:33459] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:37,457 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 15:03:37,457 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 15:03:37,457 DEBUG [RS:0;jenkins-hbase4:32965] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,457 DEBUG [RS:0;jenkins-hbase4:32965] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32965,1675782217120' 2023-02-07 15:03:37,458 DEBUG [RS:0;jenkins-hbase4:32965] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:37,458 DEBUG [RS:0;jenkins-hbase4:32965] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:37,458 DEBUG [RS:0;jenkins-hbase4:32965] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 15:03:37,458 INFO [RS:0;jenkins-hbase4:32965] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 15:03:37,458 INFO [RS:0;jenkins-hbase4:32965] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 15:03:37,507 DEBUG [jenkins-hbase4:39629] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 15:03:37,507 DEBUG [jenkins-hbase4:39629] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:37,508 DEBUG [jenkins-hbase4:39629] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:37,508 DEBUG [jenkins-hbase4:39629] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:37,508 DEBUG [jenkins-hbase4:39629] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:37,508 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33459,1675782217154, state=OPENING 2023-02-07 15:03:37,510 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 15:03:37,511 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:37,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33459,1675782217154}] 2023-02-07 15:03:37,511 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:37,666 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:37,666 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:37,667 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:37,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 15:03:37,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 15:03:37,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33459%2C1675782217154.meta, suffix=.meta, logDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,33459,1675782217154, archiveDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/oldWALs, maxLogs=32 2023-02-07 15:03:37,687 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK] 2023-02-07 15:03:37,687 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK] 2023-02-07 15:03:37,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,33459,1675782217154/jenkins-hbase4.apache.org%2C33459%2C1675782217154.meta.1675782217672.meta 2023-02-07 15:03:37,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK], DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK]] 2023-02-07 15:03:37,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:37,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 15:03:37,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 15:03:37,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 15:03:37,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 15:03:37,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:37,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 15:03:37,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 15:03:37,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 15:03:37,691 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/info 2023-02-07 15:03:37,691 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/info 2023-02-07 15:03:37,692 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 15:03:37,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:37,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 15:03:37,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:37,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/rep_barrier 2023-02-07 15:03:37,693 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 15:03:37,694 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:37,694 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 15:03:37,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/table 2023-02-07 15:03:37,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/table 2023-02-07 15:03:37,695 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 15:03:37,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:37,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740 2023-02-07 15:03:37,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740 2023-02-07 15:03:37,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 15:03:37,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 15:03:37,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65940124, jitterRate=-0.01741558313369751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 15:03:37,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675782217690Writing region info on filesystem at 1675782217690Initializing all the Stores at 1675782217690Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782217690Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782217690Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782217690Cleaning up temporary data from old regions at 1675782217697 (+7 ms)Cleaning up detritus from prior splits at 1675782217698 (+1 ms)Running coprocessor post-open hooks at 1675782217700 (+2 ms)Region opened successfully at 1675782217700 2023-02-07 15:03:37,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675782217666 2023-02-07 15:03:37,704 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 15:03:37,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 15:03:37,706 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33459,1675782217154, state=OPEN 2023-02-07 15:03:37,707 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 15:03:37,707 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 15:03:37,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 15:03:37,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33459,1675782217154 in 196 msec 2023-02-07 15:03:37,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 15:03:37,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-07 15:03:37,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 403 msec 2023-02-07 15:03:37,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675782217176, completionTime=-1 2023-02-07 15:03:37,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 15:03:37,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 15:03:37,713 DEBUG [hconnection-0x3c587e26-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:37,714 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:37,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 15:03:37,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675782277715 2023-02-07 15:03:37,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675782337715 2023-02-07 15:03:37,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-07 15:03:37,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39629,1675782217069-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39629,1675782217069-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39629,1675782217069-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39629, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 15:03:37,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 15:03:37,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:37,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 15:03:37,725 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 15:03:37,725 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:37,726 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:37,727 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:37,727 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c empty. 2023-02-07 15:03:37,728 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:37,728 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 15:03:37,735 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:37,736 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 97e8ab54308a0b015c02d1b4171b376c, NAME => 'hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp 2023-02-07 15:03:37,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:37,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 97e8ab54308a0b015c02d1b4171b376c, disabling compactions & flushes 2023-02-07 15:03:37,742 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:37,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:37,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. after waiting 0 ms 2023-02-07 15:03:37,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:37,742 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:37,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 97e8ab54308a0b015c02d1b4171b376c: Waiting for close lock at 1675782217742Disabling compacts and flushes for region at 1675782217742Disabling writes for close at 1675782217742Writing region close event to WAL at 1675782217742Closed at 1675782217742 2023-02-07 15:03:37,744 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:37,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782217744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782217744"}]},"ts":"1675782217744"} 2023-02-07 15:03:37,746 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:37,746 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:37,747 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782217746"}]},"ts":"1675782217746"} 2023-02-07 15:03:37,747 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 15:03:37,750 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:37,750 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:37,751 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:37,751 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:37,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=97e8ab54308a0b015c02d1b4171b376c, ASSIGN}] 2023-02-07 15:03:37,753 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=97e8ab54308a0b015c02d1b4171b376c, ASSIGN 2023-02-07 15:03:37,753 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=97e8ab54308a0b015c02d1b4171b376c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32965,1675782217120; forceNewPlan=false, retain=false 2023-02-07 15:03:37,903 INFO [jenkins-hbase4:39629] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:37,904 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=97e8ab54308a0b015c02d1b4171b376c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:37,904 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782217904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782217904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782217904"}]},"ts":"1675782217904"} 2023-02-07 15:03:37,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 97e8ab54308a0b015c02d1b4171b376c, server=jenkins-hbase4.apache.org,32965,1675782217120}] 2023-02-07 15:03:38,058 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:38,058 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 15:03:38,060 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45672, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 15:03:38,064 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:38,065 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32965%2C1675782217120, suffix=, logDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,32965,1675782217120, archiveDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/oldWALs, maxLogs=32 2023-02-07 15:03:38,079 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK] 2023-02-07 15:03:38,079 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK] 2023-02-07 15:03:38,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,32965,1675782217120/jenkins-hbase4.apache.org%2C32965%2C1675782217120.1675782218066 2023-02-07 15:03:38,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK], DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK]] 2023-02-07 15:03:38,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 97e8ab54308a0b015c02d1b4171b376c, NAME => 'hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:38,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:38,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:38,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:38,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:38,082 INFO [StoreOpener-97e8ab54308a0b015c02d1b4171b376c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:38,083 DEBUG [StoreOpener-97e8ab54308a0b015c02d1b4171b376c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/info 2023-02-07 15:03:38,083 DEBUG [StoreOpener-97e8ab54308a0b015c02d1b4171b376c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/info 2023-02-07 15:03:38,083 INFO [StoreOpener-97e8ab54308a0b015c02d1b4171b376c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97e8ab54308a0b015c02d1b4171b376c columnFamilyName info 2023-02-07 15:03:38,084 INFO [StoreOpener-97e8ab54308a0b015c02d1b4171b376c-1] regionserver.HStore(310): Store=97e8ab54308a0b015c02d1b4171b376c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:38,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:38,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:38,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:38,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:38,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 97e8ab54308a0b015c02d1b4171b376c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69368057, jitterRate=0.03366459906101227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 15:03:38,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 97e8ab54308a0b015c02d1b4171b376c: Running coprocessor pre-open hook at 1675782218081Writing region info on filesystem at 1675782218081Initializing all the Stores at 1675782218082 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675782218082Cleaning up temporary data from old regions at 1675782218085 (+3 ms)Cleaning up detritus from prior splits at 1675782218085Running coprocessor post-open hooks at 1675782218088 (+3 ms)Region opened successfully at 1675782218088 2023-02-07 15:03:38,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c., pid=6, masterSystemTime=1675782218058 2023-02-07 15:03:38,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:38,092 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:38,092 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=97e8ab54308a0b015c02d1b4171b376c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:38,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675782218092"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782218092"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782218092"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782218092"}]},"ts":"1675782218092"} 2023-02-07 15:03:38,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 15:03:38,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 97e8ab54308a0b015c02d1b4171b376c, server=jenkins-hbase4.apache.org,32965,1675782217120 in 188 msec 2023-02-07 15:03:38,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 15:03:38,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=97e8ab54308a0b015c02d1b4171b376c, ASSIGN in 343 msec 2023-02-07 15:03:38,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:38,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782218096"}]},"ts":"1675782218096"} 2023-02-07 15:03:38,098 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 15:03:38,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:38,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-02-07 15:03:38,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 15:03:38,126 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:38,126 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:38,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:38,130 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:38,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 15:03:38,137 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:38,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-07 15:03:38,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 15:03:38,149 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 15:03:38,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-07 15:03:38,155 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 15:03:38,158 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 15:03:38,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.972sec 2023-02-07 15:03:38,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 15:03:38,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 15:03:38,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 15:03:38,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39629,1675782217069-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 15:03:38,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39629,1675782217069-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 15:03:38,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 15:03:38,175 DEBUG [Listener at localhost/40391] zookeeper.ReadOnlyZKClient(139): Connect 0x1e712f2e to 127.0.0.1:55291 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:38,177 DEBUG [Listener at localhost/40391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cb714e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:38,179 DEBUG [hconnection-0x607a2c5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:38,180 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37414, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:38,181 INFO [Listener at localhost/40391] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:38,181 DEBUG [Listener at localhost/40391] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 15:03:38,181 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,181 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,184 DEBUG [Listener at localhost/40391] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 15:03:38,185 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 15:03:38,185 INFO [Listener at localhost/40391] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 15:03:38,186 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 15:03:38,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 15:03:38,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:59556 deadline: 1675782278186, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 15:03:38,186 INFO [Listener at localhost/40391] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 15:03:38,187 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,187 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:38,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 15:03:38,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 15:03:38,191 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 15:03:38,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 15:03:38,191 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,192 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:38,191 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 15:03:38,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:38,193 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,193 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e empty. 2023-02-07 15:03:38,194 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,194 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 15:03:38,201 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 15:03:38,202 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 170a490e868d41590af6f3e6bbf40b9e, NAME => 'testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp 2023-02-07 15:03:38,208 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:38,208 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 170a490e868d41590af6f3e6bbf40b9e, disabling compactions & flushes 2023-02-07 15:03:38,208 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,208 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,208 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. after waiting 0 ms 2023-02-07 15:03:38,208 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,208 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,208 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 170a490e868d41590af6f3e6bbf40b9e: Waiting for close lock at 1675782218208Disabling compacts and flushes for region at 1675782218208Disabling writes for close at 1675782218208Writing region close event to WAL at 1675782218208Closed at 1675782218208 2023-02-07 15:03:38,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 15:03:38,211 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675782218211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782218211"}]},"ts":"1675782218211"} 2023-02-07 15:03:38,212 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 15:03:38,213 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 15:03:38,213 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782218213"}]},"ts":"1675782218213"} 2023-02-07 15:03:38,214 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 15:03:38,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 15:03:38,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 15:03:38,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 15:03:38,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 15:03:38,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=170a490e868d41590af6f3e6bbf40b9e, ASSIGN}] 2023-02-07 15:03:38,219 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=170a490e868d41590af6f3e6bbf40b9e, ASSIGN 2023-02-07 15:03:38,220 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=170a490e868d41590af6f3e6bbf40b9e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32965,1675782217120; forceNewPlan=false, retain=false 2023-02-07 15:03:38,293 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,293 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:38,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:38,370 INFO [jenkins-hbase4:39629] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 15:03:38,370 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=170a490e868d41590af6f3e6bbf40b9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:38,370 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675782218370"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782218370"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782218370"}]},"ts":"1675782218370"} 2023-02-07 15:03:38,372 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 170a490e868d41590af6f3e6bbf40b9e, server=jenkins-hbase4.apache.org,32965,1675782217120}] 2023-02-07 15:03:38,459 INFO [RS:1;jenkins-hbase4:33459] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33459%2C1675782217154, suffix=, logDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,33459,1675782217154, archiveDir=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/oldWALs, maxLogs=32 2023-02-07 15:03:38,478 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK] 2023-02-07 15:03:38,479 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK] 2023-02-07 15:03:38,480 INFO [RS:1;jenkins-hbase4:33459] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,33459,1675782217154/jenkins-hbase4.apache.org%2C33459%2C1675782217154.1675782218460 2023-02-07 15:03:38,480 DEBUG [RS:1;jenkins-hbase4:33459] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41717,DS-db9f3d6f-72ca-4ec3-96b0-b62393f6ebf9,DISK], DatanodeInfoWithStorage[127.0.0.1:35789,DS-8e97f96a-2822-48ed-91cc-733cea45c45f,DISK]] 2023-02-07 15:03:38,494 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,494 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:38,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:38,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 170a490e868d41590af6f3e6bbf40b9e, NAME => 'testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.', STARTKEY => '', ENDKEY => ''} 2023-02-07 15:03:38,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:38,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,528 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,529 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1 2023-02-07 15:03:38,529 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1 2023-02-07 15:03:38,530 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 170a490e868d41590af6f3e6bbf40b9e columnFamilyName f1 2023-02-07 15:03:38,530 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(310): Store=170a490e868d41590af6f3e6bbf40b9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:38,530 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,531 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2 2023-02-07 15:03:38,531 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2 2023-02-07 15:03:38,531 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 170a490e868d41590af6f3e6bbf40b9e columnFamilyName f2 2023-02-07 15:03:38,532 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(310): Store=170a490e868d41590af6f3e6bbf40b9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:38,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:38,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:38,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 15:03:38,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 170a490e868d41590af6f3e6bbf40b9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60839608, jitterRate=-0.09341919422149658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:38,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 170a490e868d41590af6f3e6bbf40b9e: Running coprocessor pre-open hook at 1675782218527Writing region info on filesystem at 1675782218527Initializing all the Stores at 1675782218528 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782218528Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782218528Cleaning up temporary data from old regions at 1675782218533 (+5 ms)Cleaning up detritus from prior splits at 1675782218533Running coprocessor post-open hooks at 1675782218537 (+4 ms)Region opened successfully at 1675782218537 2023-02-07 15:03:38,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e., pid=12, masterSystemTime=1675782218524 2023-02-07 15:03:38,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,540 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=170a490e868d41590af6f3e6bbf40b9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:38,540 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675782218540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675782218540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675782218540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675782218540"}]},"ts":"1675782218540"} 2023-02-07 15:03:38,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 15:03:38,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 170a490e868d41590af6f3e6bbf40b9e, server=jenkins-hbase4.apache.org,32965,1675782217120 in 170 msec 2023-02-07 15:03:38,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 15:03:38,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=170a490e868d41590af6f3e6bbf40b9e, ASSIGN in 324 msec 2023-02-07 15:03:38,545 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 15:03:38,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782218545"}]},"ts":"1675782218545"} 2023-02-07 15:03:38,546 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 15:03:38,548 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 15:03:38,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 359 msec 2023-02-07 15:03:38,796 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,796 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:38,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 15:03:38,798 INFO [Listener at localhost/40391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 15:03:38,798 DEBUG [Listener at localhost/40391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 15:03:38,798 INFO [Listener at localhost/40391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:38,800 INFO [Listener at localhost/40391] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 15:03:38,800 INFO [Listener at localhost/40391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 15:03:38,800 INFO [Listener at localhost/40391] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 15:03:38,800 INFO [Listener at localhost/40391] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 15:03:38,819 DEBUG [hconnection-0x607a2c5-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:38,833 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:38,882 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32965] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:38,922 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 15:03:38,971 INFO [Listener at localhost/40391] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 15:03:38,971 INFO [Listener at localhost/40391] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 15:03:38,971 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:38,971 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:38,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:03:38,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675782218972 (current time:1675782218972). 2023-02-07 15:03:38,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 15:03:38,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] zookeeper.ReadOnlyZKClient(139): Connect 0x0af99e95 to 127.0.0.1:55291 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 15:03:38,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22c0fd5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 15:03:38,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 15:03:38,982 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 15:03:38,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0af99e95 to 127.0.0.1:55291 2023-02-07 15:03:38,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:38,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 15:03:38,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:03:38,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:03:38,988 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:03:38,989 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675782818989 2023-02-07 15:03:38,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 15:03:38,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 15:03:38,992 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 15:03:38,992 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:38,992 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 15:03:38,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:03:38,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 7 msec 2023-02-07 15:03:38,995 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:03:38,996 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675782818996 2023-02-07 15:03:39,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-07 15:03:39,012 INFO [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-07 15:03:39,012 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:39,013 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-07 15:03:39,013 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 15:03:39,014 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,014 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 15:03:39,016 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:39,016 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:39,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:39,016 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:39,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:39,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:39,016 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,016 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-07 15:03:39,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-07 15:03:39,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-07 15:03:39,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-07 15:03:39,023 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-07 15:03:39,023 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:39,023 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-07 15:03:39,023 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 15:03:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 15:03:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 15:03:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-07 15:03:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-07 15:03:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32965,1675782217120' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-07 15:03:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33459,1675782217154' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-07 15:03:39,029 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:39,029 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:39,030 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,030 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,030 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:39,030 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,030 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 15:03:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:39,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32965,1675782217120' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-07 15:03:39,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55ea0e2[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:39,032 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 15:03:39,033 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,034 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,034 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 15:03:39,034 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,034 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 15:03:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-07 15:03:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33459,1675782217154' in zk 2023-02-07 15:03:39,036 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 15:03:39,036 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 15:03:39,036 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,036 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. started... 2023-02-07 15:03:39,036 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 170a490e868d41590af6f3e6bbf40b9e 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 15:03:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-07 15:03:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-07 15:03:39,064 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f1/91ec26a15c4b4f3984921aec51e58bc7 2023-02-07 15:03:39,088 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f2/2f57071a34ff4bb4a40ed45e9a63ea4a 2023-02-07 15:03:39,092 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:39,092 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:39,093 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:39,093 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f1/91ec26a15c4b4f3984921aec51e58bc7 as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/91ec26a15c4b4f3984921aec51e58bc7 2023-02-07 15:03:39,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:03:39,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 15:03:39,094 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 15:03:39,097 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/91ec26a15c4b4f3984921aec51e58bc7, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:39,097 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f2/2f57071a34ff4bb4a40ed45e9a63ea4a as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/2f57071a34ff4bb4a40ed45e9a63ea4a 2023-02-07 15:03:39,101 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/2f57071a34ff4bb4a40ed45e9a63ea4a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 15:03:39,102 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 170a490e868d41590af6f3e6bbf40b9e in 66ms, sequenceid=5, compaction requested=false 2023-02-07 15:03:39,102 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 170a490e868d41590af6f3e6bbf40b9e: 2023-02-07 15:03:39,103 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-07 15:03:39,103 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 15:03:39,103 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/91ec26a15c4b4f3984921aec51e58bc7] hfiles 2023-02-07 15:03:39,103 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/91ec26a15c4b4f3984921aec51e58bc7 for snapshot=testWithMapReduceSingleRegion 2023-02-07 15:03:39,103 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/2f57071a34ff4bb4a40ed45e9a63ea4a] hfiles 2023-02-07 15:03:39,103 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/2f57071a34ff4bb4a40ed45e9a63ea4a for snapshot=testWithMapReduceSingleRegion 2023-02-07 15:03:39,112 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. completed. 2023-02-07 15:03:39,112 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,112 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 15:03:39,112 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 15:03:39,112 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,112 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-07 15:03:39,112 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32965,1675782217120' in zk 2023-02-07 15:03:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-07 15:03:39,114 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-07 15:03:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 15:03:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 15:03:39,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,32965,1675782217120': 2023-02-07 15:03:39,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32965,1675782217120' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 15:03:39,117 INFO [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-07 15:03:39,118 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:39,118 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:39,118 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-07 15:03:39,118 INFO [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 15:03:39,119 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,119 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,119 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,119 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,119 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 15:03:39,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:39,120 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,120 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 15:03:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 15:03:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,122 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:39,122 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 15:03:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,128 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,128 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:39,128 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 15:03:39,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:39,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 15:03:39,128 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:39,128 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 15:03:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 15:03:39,128 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 15:03:39,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-07 15:03:39,128 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:39,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-07 15:03:39,128 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,129 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 15:03:39,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:39,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 15:03:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 15:03:39,129 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,129 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,129 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,129 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 15:03:39,129 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 15:03:39,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 15:03:39,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-07 15:03:39,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-07 15:03:39,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 15:03:39,160 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 15:03:39,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675782218991Consolidate snapshot: testWithMapReduceSingleRegion at 1675782219129 (+138 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675782219129Writing data manifest for testWithMapReduceSingleRegion at 1675782219131 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675782219137 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675782219160 (+23 ms) 2023-02-07 15:03:39,163 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 15:03:39,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 171 msec 2023-02-07 15:03:39,294 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 15:03:39,294 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:39,294 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:39,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 15:03:39,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 15:03:39,296 INFO [Listener at localhost/40391] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 15:03:39,296 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:39,296 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:39,299 INFO [Listener at localhost/40391] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 15:03:39,304 INFO [Listener at localhost/40391] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 15:03:39,331 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32965] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,582 INFO [Listener at localhost/40391] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 15:03:39,585 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:39,585 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:39,587 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 15:03:39,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 15:03:39,588 INFO [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 15:03:39,588 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:39,588 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 15:03:39,588 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 15:03:39,589 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,589 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:39,590 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:39,590 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:39,590 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:39,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:39,590 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,590 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 15:03:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 15:03:39,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33459,1675782217154' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 15:03:39,592 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 15:03:39,592 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,592 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. started... 2023-02-07 15:03:39,592 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 170a490e868d41590af6f3e6bbf40b9e 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 15:03:39,593 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,594 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,594 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:39,622 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f1/e2c50d61533c4d8ab99a9f6fa2c62d6a 2023-02-07 15:03:39,640 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f2/c33fcd041c3143e09baa418c0cd6f337 2023-02-07 15:03:39,645 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f1/e2c50d61533c4d8ab99a9f6fa2c62d6a as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/e2c50d61533c4d8ab99a9f6fa2c62d6a 2023-02-07 15:03:39,648 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/e2c50d61533c4d8ab99a9f6fa2c62d6a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:39,649 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/.tmp/f2/c33fcd041c3143e09baa418c0cd6f337 as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/c33fcd041c3143e09baa418c0cd6f337 2023-02-07 15:03:39,653 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/c33fcd041c3143e09baa418c0cd6f337, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 15:03:39,654 INFO [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 170a490e868d41590af6f3e6bbf40b9e in 61ms, sequenceid=9, compaction requested=false 2023-02-07 15:03:39,654 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 170a490e868d41590af6f3e6bbf40b9e: 2023-02-07 15:03:39,654 DEBUG [rs(jenkins-hbase4.apache.org,32965,1675782217120)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,654 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 15:03:39,654 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 15:03:39,654 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,654 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 15:03:39,654 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32965,1675782217120' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 15:03:39,655 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,655 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:39,656 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,656 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 15:03:39,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:39,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:39,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:39,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32965,1675782217120' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 15:03:39,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1613491[Count = 0] remaining members to acquire global barrier 2023-02-07 15:03:39,657 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 15:03:39,657 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,659 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,660 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,660 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 15:03:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 15:03:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 15:03:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 15:03:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33459,1675782217154' in zk 2023-02-07 15:03:39,660 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 15:03:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,32965,1675782217120' in zk 2023-02-07 15:03:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 15:03:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,33459,1675782217154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 15:03:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 15:03:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:39,662 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,32965,1675782217120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 15:03:39,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:39,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,32965,1675782217120': 2023-02-07 15:03:39,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32965,1675782217120' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 15:03:39,666 INFO [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 15:03:39,666 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 15:03:39,666 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 15:03:39,666 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 15:03:39,666 INFO [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 15:03:39,667 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,667 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 15:03:39,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,667 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:39,667 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 15:03:39,667 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:39,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:39,668 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:39,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 15:03:39,668 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 15:03:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,669 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,670 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 15:03:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 15:03:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 15:03:39,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:39,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 15:03:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:39,673 DEBUG [(jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 15:03:39,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-07 15:03:39,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 15:03:39,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:39,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 15:03:39,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 15:03:39,673 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:39,674 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,674 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:39,674 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 15:03:39,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 15:03:39,674 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 15:03:39,674 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 15:03:39,674 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 15:03:39,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 15:03:39,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 15:03:39,774 DEBUG [Listener at localhost/40391] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 15:03:39,774 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:39,775 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:39,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 15:03:39,862 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/hadoop-4016889172296029027.jar 2023-02-07 15:03:39,866 INFO [Listener at localhost/40391] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675782218972 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:39,866 DEBUG [Listener at localhost/40391] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149/data/default/testWithMapReduce 2023-02-07 15:03:39,867 INFO [Listener at localhost/40391] snapshot.RestoreSnapshotHelper(239): region to add: 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:39,867 INFO [Listener at localhost/40391] snapshot.RestoreSnapshotHelper(585): clone region=170a490e868d41590af6f3e6bbf40b9e as 170a490e868d41590af6f3e6bbf40b9e in snapshot testWithMapReduceSingleRegion 2023-02-07 15:03:39,868 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 170a490e868d41590af6f3e6bbf40b9e, NAME => 'testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149 2023-02-07 15:03:39,873 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:39,873 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91ec26a15c4b4f3984921aec51e58bc7 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-07 15:03:39,875 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f57071a34ff4bb4a40ed45e9a63ea4a from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-07 15:03:39,876 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 170a490e868d41590af6f3e6bbf40b9e, disabling compactions & flushes 2023-02-07 15:03:39,876 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,876 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. after waiting 1 ms 2023-02-07 15:03:39,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,877 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:39,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 170a490e868d41590af6f3e6bbf40b9e: Waiting for close lock at 1675782219876Disabling compacts and flushes for region at 1675782219876Disabling writes for close at 1675782219877 (+1 ms)Writing region close event to WAL at 1675782219877Closed at 1675782219877 2023-02-07 15:03:39,877 INFO [Listener at localhost/40391] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675782218972 type: FLUSH version: 2 ttl: 0 2023-02-07 15:03:39,877 DEBUG [Listener at localhost/40391] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149 2023-02-07 15:03:39,877 DEBUG [Listener at localhost/40391] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149 2023-02-07 15:03:39,877 DEBUG [Listener at localhost/40391] util.CommonFSUtils(699): |-data/ 2023-02-07 15:03:39,878 DEBUG [Listener at localhost/40391] util.CommonFSUtils(699): |----default/ 2023-02-07 15:03:39,878 DEBUG [Listener at localhost/40391] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 15:03:39,878 DEBUG [Listener at localhost/40391] util.CommonFSUtils(699): |----------170a490e868d41590af6f3e6bbf40b9e/ 2023-02-07 15:03:39,879 DEBUG [Listener at localhost/40391] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 15:03:39,879 DEBUG [Listener at localhost/40391] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 15:03:39,879 DEBUG [Listener at localhost/40391] util.CommonFSUtils(702): |----------------testWithMapReduce=170a490e868d41590af6f3e6bbf40b9e-91ec26a15c4b4f3984921aec51e58bc7 2023-02-07 15:03:39,879 DEBUG [Listener at localhost/40391] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 15:03:39,880 DEBUG [Listener at localhost/40391] util.CommonFSUtils(702): |----------------testWithMapReduce=170a490e868d41590af6f3e6bbf40b9e-2f57071a34ff4bb4a40ed45e9a63ea4a 2023-02-07 15:03:39,880 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,880 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,881 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,881 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,881 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,882 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,882 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,951 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/hadoop-1846735428219832101.jar 2023-02-07 15:03:39,951 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,951 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,952 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,952 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,952 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,953 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,953 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 15:03:39,953 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 15:03:39,954 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 15:03:39,954 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 15:03:39,954 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 15:03:39,955 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 15:03:39,955 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 15:03:39,955 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 15:03:39,956 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 15:03:39,956 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 15:03:39,956 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 15:03:39,957 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:39,957 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:39,957 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 15:03:39,958 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 15:03:40,024 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/hadoop-7181266459633019367.jar 2023-02-07 15:03:40,025 DEBUG [Listener at localhost/40391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 15:03:40,030 WARN [Listener at localhost/40391] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 15:03:40,061 INFO [Listener at localhost/40391] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 15:03:40,142 WARN [Listener at localhost/40391] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/mapreduce.cluster.local.dir/1675782220106/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 15:03:40,142 WARN [Listener at localhost/40391] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/mapreduce.cluster.local.dir/1675782220106/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 15:03:40,173 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 15:03:40,173 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 15:03:40,174 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 15:03:40,176 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:40,176 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1 2023-02-07 15:03:40,177 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 170a490e868d41590af6f3e6bbf40b9e columnFamilyName f1 2023-02-07 15:03:40,181 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(539): loaded hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/testWithMapReduce=170a490e868d41590af6f3e6bbf40b9e-91ec26a15c4b4f3984921aec51e58bc7 2023-02-07 15:03:40,181 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(310): Store=170a490e868d41590af6f3e6bbf40b9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:40,181 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:40,182 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2 2023-02-07 15:03:40,182 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 170a490e868d41590af6f3e6bbf40b9e columnFamilyName f2 2023-02-07 15:03:40,186 DEBUG [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(539): loaded hdfs://localhost:34759/user/jenkins/test-data/2261a8f8-7527-94ba-8bda-817ad33b3c16/testWithMapReduceSingleRegion/386291c8-d38d-4f26-9202-caf0d9268149/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/testWithMapReduce=170a490e868d41590af6f3e6bbf40b9e-2f57071a34ff4bb4a40ed45e9a63ea4a 2023-02-07 15:03:40,186 INFO [StoreOpener-170a490e868d41590af6f3e6bbf40b9e-1] regionserver.HStore(310): Store=170a490e868d41590af6f3e6bbf40b9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 15:03:40,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 15:03:40,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 170a490e868d41590af6f3e6bbf40b9e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75173412, jitterRate=0.12017112970352173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 15:03:40,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 170a490e868d41590af6f3e6bbf40b9e: Writing region info on filesystem at 1675782220174Initializing all the Stores at 1675782220175 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782220175Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675782220175Region opened successfully at 1675782220186 (+11 ms) 2023-02-07 15:03:40,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 170a490e868d41590af6f3e6bbf40b9e, disabling compactions & flushes 2023-02-07 15:03:40,303 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:40,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:40,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. after waiting 0 ms 2023-02-07 15:03:40,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:40,304 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:40,304 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 170a490e868d41590af6f3e6bbf40b9e: Waiting for close lock at 1675782220303Disabling compacts and flushes for region at 1675782220303Disabling writes for close at 1675782220303Writing region close event to WAL at 1675782220304 (+1 ms)Closed at 1675782220304 2023-02-07 15:03:41,176 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,176 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-07 15:03:41,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-07 15:03:41,180 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,180 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,181 INFO [Listener at localhost/40391] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 15:03:41,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 15:03:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-07 15:03:41,183 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,184 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,184 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782221184"}]},"ts":"1675782221184"} 2023-02-07 15:03:41,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:41,185 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-07 15:03:41,187 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-07 15:03:41,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=170a490e868d41590af6f3e6bbf40b9e, UNASSIGN}] 2023-02-07 15:03:41,188 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=170a490e868d41590af6f3e6bbf40b9e, UNASSIGN 2023-02-07 15:03:41,189 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=170a490e868d41590af6f3e6bbf40b9e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:41,189 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675782221189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675782221189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675782221189"}]},"ts":"1675782221189"} 2023-02-07 15:03:41,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 170a490e868d41590af6f3e6bbf40b9e, server=jenkins-hbase4.apache.org,32965,1675782217120}] 2023-02-07 15:03:41,285 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,285 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:41,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:41,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 170a490e868d41590af6f3e6bbf40b9e, disabling compactions & flushes 2023-02-07 15:03:41,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:41,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:41,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. after waiting 0 ms 2023-02-07 15:03:41,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:41,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 15:03:41,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e. 2023-02-07 15:03:41,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 170a490e868d41590af6f3e6bbf40b9e: Waiting for close lock at 1675782221342Running coprocessor pre-close hooks at 1675782221342Disabling compacts and flushes for region at 1675782221342Disabling writes for close at 1675782221342Writing region close event to WAL at 1675782221343 (+1 ms)Running coprocessor post-close hooks at 1675782221346 (+3 ms)Closed at 1675782221347 (+1 ms) 2023-02-07 15:03:41,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:41,349 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=170a490e868d41590af6f3e6bbf40b9e, regionState=CLOSED 2023-02-07 15:03:41,349 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675782221349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675782221349"}]},"ts":"1675782221349"} 2023-02-07 15:03:41,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 15:03:41,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 170a490e868d41590af6f3e6bbf40b9e, server=jenkins-hbase4.apache.org,32965,1675782217120 in 160 msec 2023-02-07 15:03:41,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 15:03:41,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=170a490e868d41590af6f3e6bbf40b9e, UNASSIGN in 164 msec 2023-02-07 15:03:41,353 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675782221353"}]},"ts":"1675782221353"} 2023-02-07 15:03:41,354 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-07 15:03:41,355 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-07 15:03:41,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 175 msec 2023-02-07 15:03:41,486 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,486 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 15:03:41,487 INFO [Listener at localhost/40391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-07 15:03:41,487 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,487 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-07 15:03:41,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:41,490 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:41,490 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,491 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,491 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:41,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:41,493 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:41,495 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1, FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2, FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/recovered.edits] 2023-02-07 15:03:41,498 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/91ec26a15c4b4f3984921aec51e58bc7 to hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/archive/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/91ec26a15c4b4f3984921aec51e58bc7 2023-02-07 15:03:41,498 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/e2c50d61533c4d8ab99a9f6fa2c62d6a to hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/archive/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f1/e2c50d61533c4d8ab99a9f6fa2c62d6a 2023-02-07 15:03:41,501 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/2f57071a34ff4bb4a40ed45e9a63ea4a to hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/archive/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/2f57071a34ff4bb4a40ed45e9a63ea4a 2023-02-07 15:03:41,502 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/c33fcd041c3143e09baa418c0cd6f337 to hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/archive/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/f2/c33fcd041c3143e09baa418c0cd6f337 2023-02-07 15:03:41,504 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/recovered.edits/12.seqid to hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/archive/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e/recovered.edits/12.seqid 2023-02-07 15:03:41,504 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/.tmp/data/default/testWithMapReduce/170a490e868d41590af6f3e6bbf40b9e 2023-02-07 15:03:41,504 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 15:03:41,506 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:41,508 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-07 15:03:41,510 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-07 15:03:41,511 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:41,511 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-07 15:03:41,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675782221511"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:41,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 15:03:41,512 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 170a490e868d41590af6f3e6bbf40b9e, NAME => 'testWithMapReduce,,1675782218189.170a490e868d41590af6f3e6bbf40b9e.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 15:03:41,512 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-07 15:03:41,512 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675782221512"}]},"ts":"9223372036854775807"} 2023-02-07 15:03:41,513 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-07 15:03:41,515 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 15:03:41,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-07 15:03:41,591 INFO [Listener at localhost/40391] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 15:03:41,592 INFO [Listener at localhost/40391] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 15:03:41,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39629] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 15:03:41,593 INFO [Listener at localhost/40391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-07 15:03:41,593 INFO [Listener at localhost/40391] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 15:03:41,593 INFO [Listener at localhost/40391] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 15:03:41,593 DEBUG [Listener at localhost/40391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e712f2e to 127.0.0.1:55291 2023-02-07 15:03:41,594 DEBUG [Listener at localhost/40391] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:41,594 DEBUG [Listener at localhost/40391] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 15:03:41,594 DEBUG [Listener at localhost/40391] util.JVMClusterUtil(257): Found active master hash=995089183, stopped=false 2023-02-07 15:03:41,594 INFO [Listener at localhost/40391] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:41,597 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:41,597 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:41,597 INFO [Listener at localhost/40391] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 15:03:41,597 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 15:03:41,597 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:41,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:41,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:41,599 DEBUG [Listener at localhost/40391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6707f5ce to 127.0.0.1:55291 2023-02-07 15:03:41,599 DEBUG [Listener at localhost/40391] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:41,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 15:03:41,599 INFO [Listener at localhost/40391] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32965,1675782217120' ***** 2023-02-07 15:03:41,599 INFO [Listener at localhost/40391] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:41,599 INFO [Listener at localhost/40391] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33459,1675782217154' ***** 2023-02-07 15:03:41,599 INFO [Listener at localhost/40391] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 15:03:41,599 INFO [RS:0;jenkins-hbase4:32965] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:41,599 INFO [RS:0;jenkins-hbase4:32965] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:41,600 INFO [RS:0;jenkins-hbase4:32965] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:41,600 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(3304): Received CLOSE for 97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:41,600 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:41,600 DEBUG [RS:0;jenkins-hbase4:32965] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x472ca757 to 127.0.0.1:55291 2023-02-07 15:03:41,600 DEBUG [RS:0;jenkins-hbase4:32965] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:41,600 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:41,600 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1479): Online Regions={97e8ab54308a0b015c02d1b4171b376c=hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c.} 2023-02-07 15:03:41,600 DEBUG [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1505): Waiting on 97e8ab54308a0b015c02d1b4171b376c 2023-02-07 15:03:41,600 INFO [RS:1;jenkins-hbase4:33459] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 15:03:41,600 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:41,600 INFO [RS:1;jenkins-hbase4:33459] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 15:03:41,601 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 15:03:41,602 INFO [RS:1;jenkins-hbase4:33459] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 15:03:41,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 97e8ab54308a0b015c02d1b4171b376c, disabling compactions & flushes 2023-02-07 15:03:41,603 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:41,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:41,603 DEBUG [RS:1;jenkins-hbase4:33459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4abe4176 to 127.0.0.1:55291 2023-02-07 15:03:41,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:41,603 DEBUG [RS:1;jenkins-hbase4:33459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:41,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. after waiting 0 ms 2023-02-07 15:03:41,603 INFO [RS:1;jenkins-hbase4:33459] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:41,603 INFO [RS:1;jenkins-hbase4:33459] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:41,603 INFO [RS:1;jenkins-hbase4:33459] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:41,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:41,603 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 15:03:41,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 97e8ab54308a0b015c02d1b4171b376c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 15:03:41,603 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 15:03:41,603 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 15:03:41,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 15:03:41,604 DEBUG [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 15:03:41,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 15:03:41,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 15:03:41,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 15:03:41,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 15:03:41,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-07 15:03:41,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/.tmp/info/5a2d0007e8174eff8da322383bfc4c1f 2023-02-07 15:03:41,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/.tmp/info/1393ab0cb29d4f02adaa3618052264ec 2023-02-07 15:03:41,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a2d0007e8174eff8da322383bfc4c1f 2023-02-07 15:03:41,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/.tmp/info/1393ab0cb29d4f02adaa3618052264ec as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/info/1393ab0cb29d4f02adaa3618052264ec 2023-02-07 15:03:41,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/info/1393ab0cb29d4f02adaa3618052264ec, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 15:03:41,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 97e8ab54308a0b015c02d1b4171b376c in 18ms, sequenceid=6, compaction requested=false 2023-02-07 15:03:41,625 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/.tmp/rep_barrier/998cb4fc8ddf408a80b34b0fc0530a02 2023-02-07 15:03:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/namespace/97e8ab54308a0b015c02d1b4171b376c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 15:03:41,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:41,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 97e8ab54308a0b015c02d1b4171b376c: Waiting for close lock at 1675782221600Running coprocessor pre-close hooks at 1675782221600Disabling compacts and flushes for region at 1675782221600Disabling writes for close at 1675782221603 (+3 ms)Obtaining lock to block concurrent updates at 1675782221603Preparing flush snapshotting stores in 97e8ab54308a0b015c02d1b4171b376c at 1675782221603Finished memstore snapshotting hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675782221604 (+1 ms)Flushing stores of hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. at 1675782221604Flushing 97e8ab54308a0b015c02d1b4171b376c/info: creating writer at 1675782221604Flushing 97e8ab54308a0b015c02d1b4171b376c/info: appending metadata at 1675782221606 (+2 ms)Flushing 97e8ab54308a0b015c02d1b4171b376c/info: closing flushed file at 1675782221606Flushing 97e8ab54308a0b015c02d1b4171b376c/info: reopening flushed file at 1675782221617 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 97e8ab54308a0b015c02d1b4171b376c in 18ms, sequenceid=6, compaction requested=false at 1675782221621 (+4 ms)Writing region close event to WAL at 1675782221623 (+2 ms)Running coprocessor post-close hooks at 1675782221626 (+3 ms)Closed at 1675782221627 (+1 ms) 2023-02-07 15:03:41,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675782217723.97e8ab54308a0b015c02d1b4171b376c. 2023-02-07 15:03:41,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 998cb4fc8ddf408a80b34b0fc0530a02 2023-02-07 15:03:41,630 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:41,634 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:41,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/.tmp/table/87cdf5915275488f9d4a70d0c6c70dd4 2023-02-07 15:03:41,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87cdf5915275488f9d4a70d0c6c70dd4 2023-02-07 15:03:41,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/.tmp/info/5a2d0007e8174eff8da322383bfc4c1f as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/info/5a2d0007e8174eff8da322383bfc4c1f 2023-02-07 15:03:41,645 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a2d0007e8174eff8da322383bfc4c1f 2023-02-07 15:03:41,645 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/info/5a2d0007e8174eff8da322383bfc4c1f, entries=12, sequenceid=21, filesize=6.2 K 2023-02-07 15:03:41,646 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/.tmp/rep_barrier/998cb4fc8ddf408a80b34b0fc0530a02 as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/rep_barrier/998cb4fc8ddf408a80b34b0fc0530a02 2023-02-07 15:03:41,649 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 998cb4fc8ddf408a80b34b0fc0530a02 2023-02-07 15:03:41,649 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/rep_barrier/998cb4fc8ddf408a80b34b0fc0530a02, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 15:03:41,650 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/.tmp/table/87cdf5915275488f9d4a70d0c6c70dd4 as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/table/87cdf5915275488f9d4a70d0c6c70dd4 2023-02-07 15:03:41,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87cdf5915275488f9d4a70d0c6c70dd4 2023-02-07 15:03:41,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/table/87cdf5915275488f9d4a70d0c6c70dd4, entries=4, sequenceid=21, filesize=5.0 K 2023-02-07 15:03:41,654 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-07 15:03:41,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 15:03:41,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 15:03:41,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:41,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675782221604Running coprocessor pre-close hooks at 1675782221604Disabling compacts and flushes for region at 1675782221604Disabling writes for close at 1675782221604Obtaining lock to block concurrent updates at 1675782221604Preparing flush snapshotting stores in 1588230740 at 1675782221604Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675782221604Flushing stores of hbase:meta,,1.1588230740 at 1675782221604Flushing 1588230740/info: creating writer at 1675782221604Flushing 1588230740/info: appending metadata at 1675782221606 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675782221606Flushing 1588230740/rep_barrier: creating writer at 1675782221616 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675782221618 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675782221618Flushing 1588230740/table: creating writer at 1675782221629 (+11 ms)Flushing 1588230740/table: appending metadata at 1675782221632 (+3 ms)Flushing 1588230740/table: closing flushed file at 1675782221632Flushing 1588230740/info: reopening flushed file at 1675782221642 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675782221646 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675782221650 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false at 1675782221654 (+4 ms)Writing region close event to WAL at 1675782221656 (+2 ms)Running coprocessor post-close hooks at 1675782221659 (+3 ms)Closed at 1675782221660 (+1 ms) 2023-02-07 15:03:41,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 15:03:41,800 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32965,1675782217120; all regions closed. 2023-02-07 15:03:41,804 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33459,1675782217154; all regions closed. 2023-02-07 15:03:41,806 DEBUG [RS:0;jenkins-hbase4:32965] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/oldWALs 2023-02-07 15:03:41,806 INFO [RS:0;jenkins-hbase4:32965] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32965%2C1675782217120:(num 1675782218066) 2023-02-07 15:03:41,806 DEBUG [RS:0;jenkins-hbase4:32965] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:41,806 INFO [RS:0;jenkins-hbase4:32965] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:41,806 INFO [RS:0;jenkins-hbase4:32965] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:41,806 INFO [RS:0;jenkins-hbase4:32965] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 15:03:41,806 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:41,806 INFO [RS:0;jenkins-hbase4:32965] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 15:03:41,806 INFO [RS:0;jenkins-hbase4:32965] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 15:03:41,807 INFO [RS:0;jenkins-hbase4:32965] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32965 2023-02-07 15:03:41,809 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:41,809 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:41,809 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:41,809 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32965,1675782217120 2023-02-07 15:03:41,809 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bfe6906 rejected from java.util.concurrent.ThreadPoolExecutor@1fc1eea1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:41,809 DEBUG [RS:1;jenkins-hbase4:33459] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/oldWALs 2023-02-07 15:03:41,809 INFO [RS:1;jenkins-hbase4:33459] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33459%2C1675782217154.meta:.meta(num 1675782217672) 2023-02-07 15:03:41,809 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:41,810 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32965,1675782217120] 2023-02-07 15:03:41,810 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32965,1675782217120; numProcessing=1 2023-02-07 15:03:41,811 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32965,1675782217120 already deleted, retry=false 2023-02-07 15:03:41,811 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32965,1675782217120 expired; onlineServers=1 2023-02-07 15:03:41,811 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/WALs/jenkins-hbase4.apache.org,33459,1675782217154/jenkins-hbase4.apache.org%2C33459%2C1675782217154.1675782218460 not finished, retry = 0 2023-02-07 15:03:41,914 DEBUG [RS:1;jenkins-hbase4:33459] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/oldWALs 2023-02-07 15:03:41,914 INFO [RS:1;jenkins-hbase4:33459] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33459%2C1675782217154:(num 1675782218460) 2023-02-07 15:03:41,914 DEBUG [RS:1;jenkins-hbase4:33459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:41,914 INFO [RS:1;jenkins-hbase4:33459] regionserver.LeaseManager(133): Closed leases 2023-02-07 15:03:41,914 INFO [RS:1;jenkins-hbase4:33459] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 15:03:41,914 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:41,917 INFO [RS:1;jenkins-hbase4:33459] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33459 2023-02-07 15:03:41,920 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33459,1675782217154 2023-02-07 15:03:41,920 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 15:03:41,920 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4454d66f rejected from java.util.concurrent.ThreadPoolExecutor@406b4a3d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:41,921 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33459,1675782217154] 2023-02-07 15:03:41,921 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33459,1675782217154; numProcessing=2 2023-02-07 15:03:41,921 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33459,1675782217154 already deleted, retry=false 2023-02-07 15:03:41,922 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33459,1675782217154 expired; onlineServers=0 2023-02-07 15:03:41,922 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39629,1675782217069' ***** 2023-02-07 15:03:41,922 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 15:03:41,922 DEBUG [M:0;jenkins-hbase4:39629] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f7058ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 15:03:41,923 INFO [M:0;jenkins-hbase4:39629] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39629,1675782217069 2023-02-07 15:03:41,923 INFO [M:0;jenkins-hbase4:39629] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39629,1675782217069; all regions closed. 2023-02-07 15:03:41,923 DEBUG [M:0;jenkins-hbase4:39629] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 15:03:41,923 DEBUG [M:0;jenkins-hbase4:39629] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 15:03:41,923 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 15:03:41,923 DEBUG [M:0;jenkins-hbase4:39629] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 15:03:41,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782217315] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675782217315,5,FailOnTimeoutGroup] 2023-02-07 15:03:41,923 INFO [M:0;jenkins-hbase4:39629] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 15:03:41,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782217315] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675782217315,5,FailOnTimeoutGroup] 2023-02-07 15:03:41,924 INFO [M:0;jenkins-hbase4:39629] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 15:03:41,924 INFO [M:0;jenkins-hbase4:39629] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 15:03:41,924 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 15:03:41,925 DEBUG [M:0;jenkins-hbase4:39629] master.HMaster(1502): Stopping service threads 2023-02-07 15:03:41,925 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 15:03:41,925 INFO [M:0;jenkins-hbase4:39629] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 15:03:41,925 ERROR [M:0;jenkins-hbase4:39629] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 15:03:41,925 INFO [M:0;jenkins-hbase4:39629] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 15:03:41,926 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 15:03:41,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 15:03:41,926 DEBUG [M:0;jenkins-hbase4:39629] zookeeper.ZKUtil(398): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 15:03:41,926 WARN [M:0;jenkins-hbase4:39629] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 15:03:41,926 INFO [M:0;jenkins-hbase4:39629] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 15:03:41,926 INFO [M:0;jenkins-hbase4:39629] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 15:03:41,927 DEBUG [M:0;jenkins-hbase4:39629] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 15:03:41,927 INFO [M:0;jenkins-hbase4:39629] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:41,927 DEBUG [M:0;jenkins-hbase4:39629] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:41,927 DEBUG [M:0;jenkins-hbase4:39629] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 15:03:41,927 DEBUG [M:0;jenkins-hbase4:39629] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:41,927 INFO [M:0;jenkins-hbase4:39629] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.69 KB heapSize=65.67 KB 2023-02-07 15:03:41,934 INFO [M:0;jenkins-hbase4:39629] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/60dfe3eef78f4c3f875acbbf0fe408e3 2023-02-07 15:03:41,938 DEBUG [M:0;jenkins-hbase4:39629] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/60dfe3eef78f4c3f875acbbf0fe408e3 as hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/60dfe3eef78f4c3f875acbbf0fe408e3 2023-02-07 15:03:41,941 INFO [M:0;jenkins-hbase4:39629] regionserver.HStore(1080): Added hdfs://localhost:34759/user/jenkins/test-data/25ba5633-3376-daeb-edba-686976ae045e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/60dfe3eef78f4c3f875acbbf0fe408e3, entries=17, sequenceid=132, filesize=8.6 K 2023-02-07 15:03:41,942 INFO [M:0;jenkins-hbase4:39629] regionserver.HRegion(2947): Finished flush of dataSize ~54.69 KB/56006, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-07 15:03:41,942 INFO [M:0;jenkins-hbase4:39629] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 15:03:41,942 DEBUG [M:0;jenkins-hbase4:39629] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675782221927Disabling compacts and flushes for region at 1675782221927Disabling writes for close at 1675782221927Obtaining lock to block concurrent updates at 1675782221927Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675782221927Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56006, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1675782221927Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675782221928 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675782221928Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675782221930 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675782221930Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675782221939 (+9 ms)Finished flush of dataSize ~54.69 KB/56006, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false at 1675782221942 (+3 ms)Writing region close event to WAL at 1675782221942Closed at 1675782221942 2023-02-07 15:03:41,944 INFO [M:0;jenkins-hbase4:39629] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 15:03:41,944 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 15:03:41,945 INFO [M:0;jenkins-hbase4:39629] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39629 2023-02-07 15:03:41,947 DEBUG [M:0;jenkins-hbase4:39629] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39629,1675782217069 already deleted, retry=false 2023-02-07 15:03:42,097 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:42,097 INFO [M:0;jenkins-hbase4:39629] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39629,1675782217069; zookeeper connection closed. 2023-02-07 15:03:42,097 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@185297ee rejected from java.util.concurrent.ThreadPoolExecutor@1c6d103c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:42,098 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): master:39629-0x1002f4f471a0000, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:42,098 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@641dc2af rejected from java.util.concurrent.ThreadPoolExecutor@1c6d103c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:42,198 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:42,198 INFO [RS:1;jenkins-hbase4:33459] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33459,1675782217154; zookeeper connection closed. 2023-02-07 15:03:42,198 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56231cfd rejected from java.util.concurrent.ThreadPoolExecutor@406b4a3d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:42,198 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:33459-0x1002f4f471a0002, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:42,198 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e06c1f3 rejected from java.util.concurrent.ThreadPoolExecutor@406b4a3d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:42,198 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f910208] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f910208 2023-02-07 15:03:42,298 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:42,298 INFO [RS:0;jenkins-hbase4:32965] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32965,1675782217120; zookeeper connection closed. 2023-02-07 15:03:42,298 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38d72b9 rejected from java.util.concurrent.ThreadPoolExecutor@1fc1eea1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:42,298 DEBUG [Listener at localhost/40391-EventThread] zookeeper.ZKWatcher(600): regionserver:32965-0x1002f4f471a0001, quorum=127.0.0.1:55291, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 15:03:42,298 ERROR [Listener at localhost/40391-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b77d2aa rejected from java.util.concurrent.ThreadPoolExecutor@1fc1eea1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 15:03:42,298 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@74e3afad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@74e3afad 2023-02-07 15:03:42,298 INFO [Listener at localhost/40391] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 15:03:42,299 WARN [Listener at localhost/40391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:42,305 INFO [Listener at localhost/40391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:42,406 WARN [BP-1526971297-172.31.14.131-1675782216473 heartbeating to localhost/127.0.0.1:34759] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:42,406 WARN [BP-1526971297-172.31.14.131-1675782216473 heartbeating to localhost/127.0.0.1:34759] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1526971297-172.31.14.131-1675782216473 (Datanode Uuid b5899a17-cf53-4515-881b-c2889398edbc) service to localhost/127.0.0.1:34759 2023-02-07 15:03:42,407 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3/dfs/data/data3/current/BP-1526971297-172.31.14.131-1675782216473] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:42,407 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3/dfs/data/data4/current/BP-1526971297-172.31.14.131-1675782216473] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:42,409 WARN [Listener at localhost/40391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 15:03:42,412 INFO [Listener at localhost/40391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:42,513 WARN [BP-1526971297-172.31.14.131-1675782216473 heartbeating to localhost/127.0.0.1:34759] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 15:03:42,513 WARN [BP-1526971297-172.31.14.131-1675782216473 heartbeating to localhost/127.0.0.1:34759] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1526971297-172.31.14.131-1675782216473 (Datanode Uuid d1ba005f-ad94-4c24-adbb-e3b391345e26) service to localhost/127.0.0.1:34759 2023-02-07 15:03:42,514 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3/dfs/data/data1/current/BP-1526971297-172.31.14.131-1675782216473] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:42,514 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cc22de3c-0380-92ac-7a10-c5e58784dcb2/cluster_640eb75d-70cc-94c1-7c7d-1012df2c84d3/dfs/data/data2/current/BP-1526971297-172.31.14.131-1675782216473] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 15:03:42,528 INFO [Listener at localhost/40391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 15:03:42,645 INFO [Listener at localhost/40391] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 15:03:42,670 INFO [Listener at localhost/40391] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 15:03:42,682 INFO [Listener at localhost/40391] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=296 (was 276) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40391 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39629,1675782217069)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:34759 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:34759 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:34759 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34759 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:34759 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:34759 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (813912309) connection to localhost/127.0.0.1:34759 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=607 (was 577) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 284), ProcessCount=166 (was 166), AvailableMemoryMB=5367 (was 5405)