2023-07-12 19:05:03,115 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta timeout: 13 mins 2023-07-12 19:05:03,151 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=9, OpenFileDescriptor=256, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=166, AvailableMemoryMB=6526 2023-07-12 19:05:03,394 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0 2023-07-12 19:05:03,397 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 19:05:03,397 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1, deleteOnExit=true 2023-07-12 19:05:03,398 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 19:05:03,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/test.cache.data in system properties and HBase conf 2023-07-12 19:05:03,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 19:05:03,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/hadoop.log.dir in system properties and HBase conf 2023-07-12 19:05:03,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 19:05:03,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 19:05:03,400 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 19:05:03,488 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 19:05:03,808 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 19:05:03,811 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 19:05:03,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 19:05:03,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 19:05:03,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 19:05:03,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 19:05:03,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 19:05:03,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 19:05:03,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 19:05:03,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 19:05:03,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/nfs.dump.dir in system properties and HBase conf 2023-07-12 19:05:03,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/java.io.tmpdir in system properties and HBase conf 2023-07-12 19:05:03,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 19:05:03,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 19:05:03,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 19:05:04,263 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 19:05:04,267 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 19:05:04,499 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 19:05:04,645 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 19:05:04,665 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 19:05:04,703 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 19:05:04,730 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/java.io.tmpdir/Jetty_localhost_localdomain_37183_hdfs____.8esuu6/webapp 2023-07-12 19:05:04,870 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:37183 2023-07-12 19:05:04,878 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 19:05:04,878 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 19:05:05,214 WARN [Listener at localhost.localdomain/39619] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 19:05:05,304 WARN [Listener at localhost.localdomain/39619] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 19:05:05,321 WARN [Listener at localhost.localdomain/39619] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 19:05:05,327 INFO [Listener at localhost.localdomain/39619] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 19:05:05,332 INFO [Listener at localhost.localdomain/39619] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/java.io.tmpdir/Jetty_localhost_36111_datanode____mujbg5/webapp 2023-07-12 19:05:05,417 INFO [Listener at localhost.localdomain/39619] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36111 2023-07-12 19:05:05,741 WARN [Listener at localhost.localdomain/40989] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 19:05:05,754 WARN [Listener at localhost.localdomain/40989] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 19:05:05,757 WARN [Listener at localhost.localdomain/40989] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 19:05:05,760 INFO [Listener at localhost.localdomain/40989] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 19:05:05,767 INFO [Listener at localhost.localdomain/40989] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/java.io.tmpdir/Jetty_localhost_37931_datanode____.fyakva/webapp 2023-07-12 19:05:05,859 INFO [Listener at localhost.localdomain/40989] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37931 2023-07-12 19:05:05,871 WARN [Listener at localhost.localdomain/45349] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 19:05:05,885 WARN [Listener at localhost.localdomain/45349] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 19:05:05,890 WARN [Listener at localhost.localdomain/45349] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 19:05:05,892 INFO [Listener at localhost.localdomain/45349] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 19:05:05,898 INFO [Listener at localhost.localdomain/45349] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/java.io.tmpdir/Jetty_localhost_35631_datanode____.2txorr/webapp 2023-07-12 19:05:05,998 INFO [Listener at localhost.localdomain/45349] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35631 2023-07-12 19:05:06,007 WARN [Listener at localhost.localdomain/45243] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 19:05:06,183 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf2cad1573293784f: Processing first storage report for DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4 from datanode 0984da87-f112-4262-b2e6-2dfc9dba7752 2023-07-12 19:05:06,185 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf2cad1573293784f: from storage DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4 node DatanodeRegistration(127.0.0.1:34459, datanodeUuid=0984da87-f112-4262-b2e6-2dfc9dba7752, infoPort=43269, infoSecurePort=0, ipcPort=45349, storageInfo=lv=-57;cid=testClusterID;nsid=1283547534;c=1689188704330), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 19:05:06,186 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48e5758ec89ad44: Processing first storage report for DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab from datanode 886114ee-318e-4fdc-8da8-714328a2121c 2023-07-12 19:05:06,186 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48e5758ec89ad44: from storage DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab node DatanodeRegistration(127.0.0.1:45871, datanodeUuid=886114ee-318e-4fdc-8da8-714328a2121c, infoPort=33051, infoSecurePort=0, ipcPort=45243, storageInfo=lv=-57;cid=testClusterID;nsid=1283547534;c=1689188704330), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 19:05:06,186 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6416bb6eacd9c6ab: Processing first storage report for DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25 from datanode 91a64be1-94ca-469a-9775-b270878670ac 2023-07-12 19:05:06,186 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6416bb6eacd9c6ab: from storage DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25 node DatanodeRegistration(127.0.0.1:40545, datanodeUuid=91a64be1-94ca-469a-9775-b270878670ac, infoPort=35211, infoSecurePort=0, ipcPort=40989, storageInfo=lv=-57;cid=testClusterID;nsid=1283547534;c=1689188704330), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 19:05:06,186 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf2cad1573293784f: Processing first storage report for DS-3d071a3f-da82-44aa-a260-b6acf0e8ab09 from datanode 0984da87-f112-4262-b2e6-2dfc9dba7752 2023-07-12 19:05:06,186 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf2cad1573293784f: from storage DS-3d071a3f-da82-44aa-a260-b6acf0e8ab09 node DatanodeRegistration(127.0.0.1:34459, datanodeUuid=0984da87-f112-4262-b2e6-2dfc9dba7752, infoPort=43269, infoSecurePort=0, ipcPort=45349, storageInfo=lv=-57;cid=testClusterID;nsid=1283547534;c=1689188704330), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 19:05:06,187 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48e5758ec89ad44: Processing first storage report for DS-89eb287f-a11a-4440-b032-d12af70ed875 from datanode 886114ee-318e-4fdc-8da8-714328a2121c 2023-07-12 19:05:06,187 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48e5758ec89ad44: from storage DS-89eb287f-a11a-4440-b032-d12af70ed875 node DatanodeRegistration(127.0.0.1:45871, datanodeUuid=886114ee-318e-4fdc-8da8-714328a2121c, infoPort=33051, infoSecurePort=0, ipcPort=45243, storageInfo=lv=-57;cid=testClusterID;nsid=1283547534;c=1689188704330), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 19:05:06,187 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6416bb6eacd9c6ab: Processing first storage report for DS-79c2d945-3461-4538-a50e-7f58a467a98c from datanode 91a64be1-94ca-469a-9775-b270878670ac 2023-07-12 19:05:06,187 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6416bb6eacd9c6ab: from storage DS-79c2d945-3461-4538-a50e-7f58a467a98c node DatanodeRegistration(127.0.0.1:40545, datanodeUuid=91a64be1-94ca-469a-9775-b270878670ac, infoPort=35211, infoSecurePort=0, ipcPort=40989, storageInfo=lv=-57;cid=testClusterID;nsid=1283547534;c=1689188704330), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 19:05:06,369 DEBUG [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0 2023-07-12 19:05:06,423 INFO [Listener at localhost.localdomain/45243] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/zookeeper_0, clientPort=62537, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 19:05:06,435 INFO [Listener at localhost.localdomain/45243] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62537 2023-07-12 19:05:06,447 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:06,450 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:07,069 INFO [Listener at localhost.localdomain/45243] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd with version=8 2023-07-12 19:05:07,069 INFO [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/hbase-staging 2023-07-12 19:05:07,321 INFO [Listener at localhost.localdomain/45243] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 19:05:07,700 INFO [Listener at localhost.localdomain/45243] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 19:05:07,726 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:07,726 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:07,727 INFO [Listener at localhost.localdomain/45243] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 19:05:07,727 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:07,727 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 19:05:07,848 INFO [Listener at localhost.localdomain/45243] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 19:05:07,909 DEBUG [Listener at localhost.localdomain/45243] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 19:05:07,989 INFO [Listener at localhost.localdomain/45243] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41319 2023-07-12 19:05:07,998 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,001 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,020 INFO [Listener at localhost.localdomain/45243] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41319 connecting to ZooKeeper ensemble=127.0.0.1:62537 2023-07-12 19:05:08,052 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:413190x0, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 19:05:08,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41319-0x1008292a4e80000 connected 2023-07-12 19:05:08,076 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 19:05:08,077 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 19:05:08,080 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 19:05:08,086 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41319 2023-07-12 19:05:08,087 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41319 2023-07-12 19:05:08,087 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41319 2023-07-12 19:05:08,088 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41319 2023-07-12 19:05:08,088 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41319 2023-07-12 19:05:08,093 INFO [Listener at localhost.localdomain/45243] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd, hbase.cluster.distributed=false 2023-07-12 19:05:08,157 INFO [Listener at localhost.localdomain/45243] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 19:05:08,157 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,157 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,158 INFO [Listener at localhost.localdomain/45243] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 19:05:08,158 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,158 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 19:05:08,162 INFO [Listener at localhost.localdomain/45243] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 19:05:08,165 INFO [Listener at localhost.localdomain/45243] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44977 2023-07-12 19:05:08,167 INFO [Listener at localhost.localdomain/45243] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 19:05:08,172 DEBUG [Listener at localhost.localdomain/45243] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 19:05:08,173 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,175 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,178 INFO [Listener at localhost.localdomain/45243] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44977 connecting to ZooKeeper ensemble=127.0.0.1:62537 2023-07-12 19:05:08,185 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:449770x0, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 19:05:08,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44977-0x1008292a4e80001 connected 2023-07-12 19:05:08,186 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 19:05:08,188 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 19:05:08,189 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 19:05:08,189 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44977 2023-07-12 19:05:08,190 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44977 2023-07-12 19:05:08,190 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44977 2023-07-12 19:05:08,191 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44977 2023-07-12 19:05:08,191 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44977 2023-07-12 19:05:08,202 INFO [Listener at localhost.localdomain/45243] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 19:05:08,202 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,203 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,203 INFO [Listener at localhost.localdomain/45243] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 19:05:08,204 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,204 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 19:05:08,204 INFO [Listener at localhost.localdomain/45243] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 19:05:08,206 INFO [Listener at localhost.localdomain/45243] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35281 2023-07-12 19:05:08,207 INFO [Listener at localhost.localdomain/45243] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 19:05:08,208 DEBUG [Listener at localhost.localdomain/45243] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 19:05:08,209 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,211 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,213 INFO [Listener at localhost.localdomain/45243] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35281 connecting to ZooKeeper ensemble=127.0.0.1:62537 2023-07-12 19:05:08,217 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:352810x0, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 19:05:08,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35281-0x1008292a4e80002 connected 2023-07-12 19:05:08,219 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 19:05:08,220 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 19:05:08,221 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 19:05:08,222 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35281 2023-07-12 19:05:08,222 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35281 2023-07-12 19:05:08,223 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35281 2023-07-12 19:05:08,225 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35281 2023-07-12 19:05:08,226 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35281 2023-07-12 19:05:08,237 INFO [Listener at localhost.localdomain/45243] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 19:05:08,237 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,237 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,237 INFO [Listener at localhost.localdomain/45243] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 19:05:08,237 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 19:05:08,237 INFO [Listener at localhost.localdomain/45243] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 19:05:08,238 INFO [Listener at localhost.localdomain/45243] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 19:05:08,239 INFO [Listener at localhost.localdomain/45243] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36833 2023-07-12 19:05:08,239 INFO [Listener at localhost.localdomain/45243] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 19:05:08,240 DEBUG [Listener at localhost.localdomain/45243] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 19:05:08,241 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,243 INFO [Listener at localhost.localdomain/45243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,244 INFO [Listener at localhost.localdomain/45243] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36833 connecting to ZooKeeper ensemble=127.0.0.1:62537 2023-07-12 19:05:08,248 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:368330x0, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 19:05:08,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36833-0x1008292a4e80003 connected 2023-07-12 19:05:08,249 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 19:05:08,250 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 19:05:08,251 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ZKUtil(164): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 19:05:08,252 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36833 2023-07-12 19:05:08,252 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36833 2023-07-12 19:05:08,252 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36833 2023-07-12 19:05:08,253 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36833 2023-07-12 19:05:08,253 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36833 2023-07-12 19:05:08,255 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:08,265 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 19:05:08,266 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:08,281 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 19:05:08,281 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 19:05:08,281 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 19:05:08,281 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 19:05:08,282 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:08,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 19:05:08,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 19:05:08,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,41319,1689188707186 from backup master directory 2023-07-12 19:05:08,292 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:08,292 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 19:05:08,293 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 19:05:08,293 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:08,295 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 19:05:08,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 19:05:08,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/hbase.id with ID: 8bcb340c-ebb6-43eb-b46b-b9ccf6f92074 2023-07-12 19:05:08,438 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 19:05:08,453 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:08,540 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3ca57b17 to 127.0.0.1:62537 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 19:05:08,570 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ac0a42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 19:05:08,589 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 19:05:08,590 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 19:05:08,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 19:05:08,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 19:05:08,605 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:08,608 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:08,609 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 19:05:08,639 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store-tmp 2023-07-12 19:05:08,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:08,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 19:05:08,673 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:05:08,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:05:08,674 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 19:05:08,674 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:05:08,674 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:05:08,674 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 19:05:08,675 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/WALs/jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:08,694 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41319%2C1689188707186, suffix=, logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/WALs/jenkins-hbase20.apache.org,41319,1689188707186, archiveDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/oldWALs, maxLogs=10 2023-07-12 19:05:08,744 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK] 2023-07-12 19:05:08,744 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK] 2023-07-12 19:05:08,744 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK] 2023-07-12 19:05:08,752 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:08,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/WALs/jenkins-hbase20.apache.org,41319,1689188707186/jenkins-hbase20.apache.org%2C41319%2C1689188707186.1689188708703 2023-07-12 19:05:08,813 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK], DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK], DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK]] 2023-07-12 19:05:08,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 19:05:08,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:08,817 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 19:05:08,818 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 19:05:08,868 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 19:05:08,875 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 19:05:08,895 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 19:05:08,905 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:08,911 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 19:05:08,912 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 19:05:08,928 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 19:05:08,933 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:08,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59430600, jitterRate=-0.11441504955291748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 19:05:08,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 19:05:08,935 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 19:05:08,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:05:08,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:05:08,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:05:08,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 19:05:08,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 25 msec 2023-07-12 19:05:08,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 19:05:09,003 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 19:05:09,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 19:05:09,029 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 19:05:09,032 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 19:05:09,034 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 19:05:09,038 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 19:05:09,042 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 19:05:09,044 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:09,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 19:05:09,047 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 19:05:09,058 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 19:05:09,062 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 19:05:09,062 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 19:05:09,062 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 19:05:09,062 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 19:05:09,062 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:09,062 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,41319,1689188707186, sessionid=0x1008292a4e80000, setting cluster-up flag (Was=false) 2023-07-12 19:05:09,078 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:09,082 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 19:05:09,084 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:09,088 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:09,091 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 19:05:09,093 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:09,095 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.hbase-snapshot/.tmp 2023-07-12 19:05:09,157 INFO [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(951): ClusterId : 8bcb340c-ebb6-43eb-b46b-b9ccf6f92074 2023-07-12 19:05:09,157 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(951): ClusterId : 8bcb340c-ebb6-43eb-b46b-b9ccf6f92074 2023-07-12 19:05:09,157 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(951): ClusterId : 8bcb340c-ebb6-43eb-b46b-b9ccf6f92074 2023-07-12 19:05:09,162 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 19:05:09,162 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 19:05:09,162 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 19:05:09,168 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 19:05:09,168 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 19:05:09,168 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 19:05:09,168 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 19:05:09,168 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 19:05:09,168 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 19:05:09,171 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 19:05:09,171 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 19:05:09,171 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 19:05:09,174 DEBUG [RS:1;jenkins-hbase20:35281] zookeeper.ReadOnlyZKClient(139): Connect 0x53d64674 to 127.0.0.1:62537 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 19:05:09,174 DEBUG [RS:0;jenkins-hbase20:44977] zookeeper.ReadOnlyZKClient(139): Connect 0x604d95ab to 127.0.0.1:62537 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 19:05:09,174 DEBUG [RS:2;jenkins-hbase20:36833] zookeeper.ReadOnlyZKClient(139): Connect 0x754bb73f to 127.0.0.1:62537 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 19:05:09,186 DEBUG [RS:0;jenkins-hbase20:44977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e8a77d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 19:05:09,190 DEBUG [RS:0;jenkins-hbase20:44977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ab5fedb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 19:05:09,193 DEBUG [RS:2;jenkins-hbase20:36833] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b8c47e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 19:05:09,193 DEBUG [RS:2;jenkins-hbase20:36833] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fb3dc4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 19:05:09,194 DEBUG [RS:1;jenkins-hbase20:35281] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d11b27e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 19:05:09,195 DEBUG [RS:1;jenkins-hbase20:35281] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@592e2d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 19:05:09,213 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 19:05:09,218 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:44977 2023-07-12 19:05:09,218 DEBUG [RS:1;jenkins-hbase20:35281] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:35281 2023-07-12 19:05:09,219 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:36833 2023-07-12 19:05:09,223 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 19:05:09,223 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 19:05:09,223 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 19:05:09,223 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 19:05:09,223 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 19:05:09,224 INFO [RS:0;jenkins-hbase20:44977] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 19:05:09,224 INFO [RS:0;jenkins-hbase20:44977] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 19:05:09,224 INFO [RS:1;jenkins-hbase20:35281] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 19:05:09,224 INFO [RS:2;jenkins-hbase20:36833] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 19:05:09,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,224 INFO [RS:2;jenkins-hbase20:36833] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 19:05:09,224 INFO [RS:1;jenkins-hbase20:35281] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 19:05:09,224 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 19:05:09,225 DEBUG [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 19:05:09,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 19:05:09,225 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 19:05:09,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,226 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188739226 2023-07-12 19:05:09,227 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41319,1689188707186 with isa=jenkins-hbase20.apache.org/148.251.75.209:36833, startcode=1689188708236 2023-07-12 19:05:09,227 INFO [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41319,1689188707186 with isa=jenkins-hbase20.apache.org/148.251.75.209:35281, startcode=1689188708201 2023-07-12 19:05:09,227 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41319,1689188707186 with isa=jenkins-hbase20.apache.org/148.251.75.209:44977, startcode=1689188708156 2023-07-12 19:05:09,228 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 19:05:09,234 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 19:05:09,234 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 19:05:09,240 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 19:05:09,243 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 19:05:09,251 DEBUG [RS:0;jenkins-hbase20:44977] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 19:05:09,251 DEBUG [RS:2;jenkins-hbase20:36833] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 19:05:09,251 DEBUG [RS:1;jenkins-hbase20:35281] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 19:05:09,255 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 19:05:09,255 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 19:05:09,256 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 19:05:09,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 19:05:09,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,260 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 19:05:09,261 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 19:05:09,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 19:05:09,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 19:05:09,265 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 19:05:09,268 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689188709266,5,FailOnTimeoutGroup] 2023-07-12 19:05:09,268 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689188709268,5,FailOnTimeoutGroup] 2023-07-12 19:05:09,268 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,269 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 19:05:09,270 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,301 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 19:05:09,303 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 19:05:09,303 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd 2023-07-12 19:05:09,328 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43593, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 19:05:09,328 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41665, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 19:05:09,328 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60729, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 19:05:09,341 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:09,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 19:05:09,346 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41319] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info 2023-07-12 19:05:09,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 19:05:09,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:09,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 19:05:09,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/rep_barrier 2023-07-12 19:05:09,351 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 19:05:09,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:09,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 19:05:09,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/table 2023-07-12 19:05:09,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 19:05:09,356 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:09,356 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41319] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,358 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41319] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,360 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740 2023-07-12 19:05:09,361 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740 2023-07-12 19:05:09,362 DEBUG [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd 2023-07-12 19:05:09,362 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd 2023-07-12 19:05:09,362 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd 2023-07-12 19:05:09,363 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:39619 2023-07-12 19:05:09,363 DEBUG [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:39619 2023-07-12 19:05:09,363 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 19:05:09,363 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:39619 2023-07-12 19:05:09,363 DEBUG [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 19:05:09,363 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 19:05:09,366 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:09,369 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 19:05:09,370 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:05:09,370 DEBUG [RS:1;jenkins-hbase20:35281] zookeeper.ZKUtil(162): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,370 WARN [RS:1;jenkins-hbase20:35281] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 19:05:09,371 DEBUG [RS:0;jenkins-hbase20:44977] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,371 INFO [RS:1;jenkins-hbase20:35281] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 19:05:09,371 WARN [RS:0;jenkins-hbase20:44977] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 19:05:09,372 DEBUG [RS:2;jenkins-hbase20:36833] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,372 INFO [RS:0;jenkins-hbase20:44977] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 19:05:09,372 WARN [RS:2;jenkins-hbase20:36833] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 19:05:09,373 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,373 INFO [RS:2;jenkins-hbase20:36833] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 19:05:09,372 DEBUG [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,373 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,374 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,36833,1689188708236] 2023-07-12 19:05:09,374 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44977,1689188708156] 2023-07-12 19:05:09,374 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35281,1689188708201] 2023-07-12 19:05:09,383 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:09,386 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72189036, jitterRate=0.07570046186447144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:09,387 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 19:05:09,387 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 19:05:09,387 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 19:05:09,387 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 19:05:09,387 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 19:05:09,387 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 19:05:09,396 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 19:05:09,396 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 19:05:09,397 DEBUG [RS:1;jenkins-hbase20:35281] zookeeper.ZKUtil(162): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,397 DEBUG [RS:2;jenkins-hbase20:36833] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,397 DEBUG [RS:0;jenkins-hbase20:44977] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,397 DEBUG [RS:1;jenkins-hbase20:35281] zookeeper.ZKUtil(162): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,397 DEBUG [RS:0;jenkins-hbase20:44977] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,398 DEBUG [RS:1;jenkins-hbase20:35281] zookeeper.ZKUtil(162): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,398 DEBUG [RS:2;jenkins-hbase20:36833] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,398 DEBUG [RS:0;jenkins-hbase20:44977] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,399 DEBUG [RS:2;jenkins-hbase20:36833] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,401 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 19:05:09,402 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 19:05:09,408 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 19:05:09,408 DEBUG [RS:1;jenkins-hbase20:35281] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 19:05:09,408 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 19:05:09,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 19:05:09,418 INFO [RS:0;jenkins-hbase20:44977] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 19:05:09,418 INFO [RS:2;jenkins-hbase20:36833] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 19:05:09,418 INFO [RS:1;jenkins-hbase20:35281] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 19:05:09,426 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 19:05:09,427 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 19:05:09,442 INFO [RS:1;jenkins-hbase20:35281] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 19:05:09,442 INFO [RS:2;jenkins-hbase20:36833] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 19:05:09,442 INFO [RS:0;jenkins-hbase20:44977] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 19:05:09,445 INFO [RS:2;jenkins-hbase20:36833] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 19:05:09,445 INFO [RS:0;jenkins-hbase20:44977] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 19:05:09,446 INFO [RS:2;jenkins-hbase20:36833] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,445 INFO [RS:1;jenkins-hbase20:35281] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 19:05:09,446 INFO [RS:0;jenkins-hbase20:44977] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,446 INFO [RS:1;jenkins-hbase20:35281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,447 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 19:05:09,447 INFO [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 19:05:09,447 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 19:05:09,454 INFO [RS:1;jenkins-hbase20:35281] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,454 INFO [RS:0;jenkins-hbase20:44977] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,454 INFO [RS:2;jenkins-hbase20:36833] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,454 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,454 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 19:05:09,456 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 19:05:09,456 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,455 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 19:05:09,456 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,456 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,457 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,457 DEBUG [RS:0;jenkins-hbase20:44977] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,457 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,457 DEBUG [RS:2;jenkins-hbase20:36833] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,457 DEBUG [RS:1;jenkins-hbase20:35281] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 19:05:09,458 INFO [RS:0;jenkins-hbase20:44977] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,458 INFO [RS:2;jenkins-hbase20:36833] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,458 INFO [RS:1;jenkins-hbase20:35281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,458 INFO [RS:2;jenkins-hbase20:36833] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,458 INFO [RS:0;jenkins-hbase20:44977] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,459 INFO [RS:2;jenkins-hbase20:36833] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,459 INFO [RS:1;jenkins-hbase20:35281] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,459 INFO [RS:0;jenkins-hbase20:44977] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,459 INFO [RS:1;jenkins-hbase20:35281] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,476 INFO [RS:0;jenkins-hbase20:44977] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 19:05:09,476 INFO [RS:2;jenkins-hbase20:36833] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 19:05:09,476 INFO [RS:1;jenkins-hbase20:35281] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 19:05:09,480 INFO [RS:1;jenkins-hbase20:35281] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35281,1689188708201-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,480 INFO [RS:2;jenkins-hbase20:36833] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36833,1689188708236-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,480 INFO [RS:0;jenkins-hbase20:44977] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44977,1689188708156-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:09,505 INFO [RS:1;jenkins-hbase20:35281] regionserver.Replication(203): jenkins-hbase20.apache.org,35281,1689188708201 started 2023-07-12 19:05:09,505 INFO [RS:0;jenkins-hbase20:44977] regionserver.Replication(203): jenkins-hbase20.apache.org,44977,1689188708156 started 2023-07-12 19:05:09,505 INFO [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,35281,1689188708201, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35281, sessionid=0x1008292a4e80002 2023-07-12 19:05:09,505 INFO [RS:2;jenkins-hbase20:36833] regionserver.Replication(203): jenkins-hbase20.apache.org,36833,1689188708236 started 2023-07-12 19:05:09,506 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44977,1689188708156, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44977, sessionid=0x1008292a4e80001 2023-07-12 19:05:09,506 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,36833,1689188708236, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:36833, sessionid=0x1008292a4e80003 2023-07-12 19:05:09,506 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 19:05:09,506 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 19:05:09,506 DEBUG [RS:1;jenkins-hbase20:35281] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,506 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 19:05:09,507 DEBUG [RS:2;jenkins-hbase20:36833] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,507 DEBUG [RS:1;jenkins-hbase20:35281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35281,1689188708201' 2023-07-12 19:05:09,506 DEBUG [RS:0;jenkins-hbase20:44977] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,507 DEBUG [RS:0;jenkins-hbase20:44977] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44977,1689188708156' 2023-07-12 19:05:09,507 DEBUG [RS:0;jenkins-hbase20:44977] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 19:05:09,507 DEBUG [RS:1;jenkins-hbase20:35281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 19:05:09,507 DEBUG [RS:2;jenkins-hbase20:36833] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36833,1689188708236' 2023-07-12 19:05:09,508 DEBUG [RS:2;jenkins-hbase20:36833] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 19:05:09,508 DEBUG [RS:0;jenkins-hbase20:44977] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 19:05:09,508 DEBUG [RS:2;jenkins-hbase20:36833] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 19:05:09,508 DEBUG [RS:1;jenkins-hbase20:35281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 19:05:09,509 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 19:05:09,509 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 19:05:09,509 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 19:05:09,509 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 19:05:09,509 DEBUG [RS:2;jenkins-hbase20:36833] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:09,509 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 19:05:09,509 DEBUG [RS:2;jenkins-hbase20:36833] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36833,1689188708236' 2023-07-12 19:05:09,510 DEBUG [RS:2;jenkins-hbase20:36833] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 19:05:09,509 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 19:05:09,510 DEBUG [RS:1;jenkins-hbase20:35281] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,509 DEBUG [RS:0;jenkins-hbase20:44977] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:09,510 DEBUG [RS:0;jenkins-hbase20:44977] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44977,1689188708156' 2023-07-12 19:05:09,510 DEBUG [RS:0;jenkins-hbase20:44977] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 19:05:09,510 DEBUG [RS:2;jenkins-hbase20:36833] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 19:05:09,510 DEBUG [RS:1;jenkins-hbase20:35281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35281,1689188708201' 2023-07-12 19:05:09,510 DEBUG [RS:1;jenkins-hbase20:35281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 19:05:09,510 DEBUG [RS:0;jenkins-hbase20:44977] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 19:05:09,510 DEBUG [RS:2;jenkins-hbase20:36833] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 19:05:09,511 DEBUG [RS:1;jenkins-hbase20:35281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 19:05:09,511 INFO [RS:2;jenkins-hbase20:36833] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 19:05:09,511 INFO [RS:2;jenkins-hbase20:36833] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 19:05:09,511 DEBUG [RS:0;jenkins-hbase20:44977] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 19:05:09,511 INFO [RS:0;jenkins-hbase20:44977] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 19:05:09,511 INFO [RS:0;jenkins-hbase20:44977] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 19:05:09,512 DEBUG [RS:1;jenkins-hbase20:35281] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 19:05:09,512 INFO [RS:1;jenkins-hbase20:35281] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 19:05:09,512 INFO [RS:1;jenkins-hbase20:35281] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 19:05:09,580 DEBUG [jenkins-hbase20:41319] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 19:05:09,585 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 19:05:09,590 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 19:05:09,590 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 19:05:09,590 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 19:05:09,591 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 19:05:09,593 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35281,1689188708201, state=OPENING 2023-07-12 19:05:09,599 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 19:05:09,600 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:09,601 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 19:05:09,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:09,622 INFO [RS:2;jenkins-hbase20:36833] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36833%2C1689188708236, suffix=, logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,36833,1689188708236, archiveDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs, maxLogs=32 2023-07-12 19:05:09,622 INFO [RS:1;jenkins-hbase20:35281] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35281%2C1689188708201, suffix=, logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201, archiveDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs, maxLogs=32 2023-07-12 19:05:09,622 INFO [RS:0;jenkins-hbase20:44977] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44977%2C1689188708156, suffix=, logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,44977,1689188708156, archiveDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs, maxLogs=32 2023-07-12 19:05:09,645 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK] 2023-07-12 19:05:09,645 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK] 2023-07-12 19:05:09,645 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK] 2023-07-12 19:05:09,656 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK] 2023-07-12 19:05:09,657 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK] 2023-07-12 19:05:09,657 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK] 2023-07-12 19:05:09,658 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK] 2023-07-12 19:05:09,658 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK] 2023-07-12 19:05:09,661 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK] 2023-07-12 19:05:09,665 INFO [RS:1;jenkins-hbase20:35281] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 2023-07-12 19:05:09,667 DEBUG [RS:1;jenkins-hbase20:35281] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK], DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK], DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK]] 2023-07-12 19:05:09,677 INFO [RS:2;jenkins-hbase20:36833] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,36833,1689188708236/jenkins-hbase20.apache.org%2C36833%2C1689188708236.1689188709627 2023-07-12 19:05:09,677 INFO [RS:0;jenkins-hbase20:44977] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,44977,1689188708156/jenkins-hbase20.apache.org%2C44977%2C1689188708156.1689188709627 2023-07-12 19:05:09,677 DEBUG [RS:2;jenkins-hbase20:36833] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK], DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK], DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK]] 2023-07-12 19:05:09,677 DEBUG [RS:0;jenkins-hbase20:44977] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK], DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK], DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK]] 2023-07-12 19:05:09,789 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:09,794 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 19:05:09,798 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 19:05:09,810 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 19:05:09,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 19:05:09,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201, archiveDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs, maxLogs=32 2023-07-12 19:05:09,836 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK] 2023-07-12 19:05:09,839 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK] 2023-07-12 19:05:09,839 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK] 2023-07-12 19:05:09,846 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta 2023-07-12 19:05:09,847 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK], DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK], DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK]] 2023-07-12 19:05:09,847 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 19:05:09,849 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 19:05:09,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 19:05:09,867 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 19:05:09,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 19:05:09,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:09,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 19:05:09,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 19:05:09,875 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 19:05:09,877 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info 2023-07-12 19:05:09,877 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info 2023-07-12 19:05:09,877 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 19:05:09,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:09,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 19:05:09,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/rep_barrier 2023-07-12 19:05:09,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/rep_barrier 2023-07-12 19:05:09,881 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 19:05:09,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:09,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 19:05:09,883 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/table 2023-07-12 19:05:09,883 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/table 2023-07-12 19:05:09,884 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 19:05:09,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:09,886 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740 2023-07-12 19:05:09,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740 2023-07-12 19:05:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:09,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 19:05:09,901 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71729186, jitterRate=0.06884816288948059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:09,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 19:05:09,910 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689188709783 2023-07-12 19:05:09,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 19:05:09,928 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 19:05:09,928 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35281,1689188708201, state=OPEN 2023-07-12 19:05:09,931 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 19:05:09,931 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 19:05:09,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 19:05:09,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35281,1689188708201 in 327 msec 2023-07-12 19:05:09,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 19:05:09,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 527 msec 2023-07-12 19:05:09,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 811 msec 2023-07-12 19:05:09,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689188709948, completionTime=-1 2023-07-12 19:05:09,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 19:05:09,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:05:10,008 DEBUG [hconnection-0x45ea540d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 19:05:10,011 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 19:05:10,028 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 19:05:10,028 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689188770028 2023-07-12 19:05:10,029 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689188830029 2023-07-12 19:05:10,029 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 80 msec 2023-07-12 19:05:10,054 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41319,1689188707186-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:10,054 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41319,1689188707186-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:10,054 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41319,1689188707186-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:10,056 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:41319, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:10,056 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 19:05:10,067 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 19:05:10,074 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 19:05:10,075 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 19:05:10,083 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 19:05:10,086 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 19:05:10,089 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 19:05:10,112 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,114 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829 empty. 2023-07-12 19:05:10,115 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,115 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 19:05:10,151 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 19:05:10,154 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 673c9299883e0a0c447ecfa6b4e5e829, NAME => 'hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:10,174 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:10,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 673c9299883e0a0c447ecfa6b4e5e829, disabling compactions & flushes 2023-07-12 19:05:10,175 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:05:10,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:05:10,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. after waiting 0 ms 2023-07-12 19:05:10,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:05:10,175 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:05:10,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 673c9299883e0a0c447ecfa6b4e5e829: 2023-07-12 19:05:10,180 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 19:05:10,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689188710182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188710182"}]},"ts":"1689188710182"} 2023-07-12 19:05:10,219 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 19:05:10,221 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 19:05:10,227 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689188710222"}]},"ts":"1689188710222"} 2023-07-12 19:05:10,233 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 19:05:10,236 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 19:05:10,238 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 19:05:10,238 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 19:05:10,238 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 19:05:10,238 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 19:05:10,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN}] 2023-07-12 19:05:10,245 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN 2023-07-12 19:05:10,247 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:10,403 INFO [jenkins-hbase20:41319] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 19:05:10,405 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:10,406 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689188710405"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188710405"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188710405"}]},"ts":"1689188710405"} 2023-07-12 19:05:10,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 673c9299883e0a0c447ecfa6b4e5e829, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:10,584 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:05:10,586 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 673c9299883e0a0c447ecfa6b4e5e829, NAME => 'hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.', STARTKEY => '', ENDKEY => ''} 2023-07-12 19:05:10,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:10,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,589 INFO [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,592 DEBUG [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/info 2023-07-12 19:05:10,592 DEBUG [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/info 2023-07-12 19:05:10,592 INFO [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 673c9299883e0a0c447ecfa6b4e5e829 columnFamilyName info 2023-07-12 19:05:10,593 INFO [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] regionserver.HStore(310): Store=673c9299883e0a0c447ecfa6b4e5e829/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:10,595 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:05:10,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:10,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 673c9299883e0a0c447ecfa6b4e5e829; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61077221, jitterRate=-0.08987848460674286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 19:05:10,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 673c9299883e0a0c447ecfa6b4e5e829: 2023-07-12 19:05:10,608 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829., pid=6, masterSystemTime=1689188710568 2023-07-12 19:05:10,612 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:05:10,612 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:05:10,614 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:10,614 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689188710613"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188710613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188710613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188710613"}]},"ts":"1689188710613"} 2023-07-12 19:05:10,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 19:05:10,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 673c9299883e0a0c447ecfa6b4e5e829, server=jenkins-hbase20.apache.org,35281,1689188708201 in 205 msec 2023-07-12 19:05:10,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 19:05:10,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN in 382 msec 2023-07-12 19:05:10,628 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 19:05:10,628 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689188710628"}]},"ts":"1689188710628"} 2023-07-12 19:05:10,631 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 19:05:10,634 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 19:05:10,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 558 msec 2023-07-12 19:05:10,689 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 19:05:10,692 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 19:05:10,692 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:05:10,733 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 19:05:10,747 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 19:05:10,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-12 19:05:10,767 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:05:10,778 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 19:05:10,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-12 19:05:10,793 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 19:05:10,794 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 19:05:10,796 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.503sec 2023-07-12 19:05:10,799 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 19:05:10,800 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 19:05:10,800 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 19:05:10,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41319,1689188707186-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 19:05:10,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41319,1689188707186-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 19:05:10,809 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 19:05:10,867 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ReadOnlyZKClient(139): Connect 0x455c5a4c to 127.0.0.1:62537 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 19:05:10,876 DEBUG [Listener at localhost.localdomain/45243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e227469, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 19:05:10,891 DEBUG [hconnection-0x7fc3471e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 19:05:10,901 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 19:05:10,910 INFO [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:10,912 WARN [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-12 19:05:10,925 DEBUG [Listener at localhost.localdomain/45243] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 19:05:10,929 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 19:05:10,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 19:05:10,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:05:10,948 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 19:05:10,952 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 19:05:10,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true" procId is: 9 2023-07-12 19:05:10,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 19:05:10,981 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:10,981 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:10,981 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:10,981 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:10,981 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:10,982 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:10,982 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:10,982 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f empty. 2023-07-12 19:05:10,982 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b empty. 2023-07-12 19:05:10,982 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:10,982 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da empty. 2023-07-12 19:05:10,983 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644 empty. 2023-07-12 19:05:10,983 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef empty. 2023-07-12 19:05:10,983 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791 empty. 2023-07-12 19:05:10,985 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c empty. 2023-07-12 19:05:10,985 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6 empty. 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:10,985 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:10,986 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:10,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:10,987 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9 empty. 2023-07-12 19:05:10,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:10,987 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01 empty. 2023-07-12 19:05:10,988 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867 empty. 2023-07-12 19:05:10,988 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab empty. 2023-07-12 19:05:10,988 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9 empty. 2023-07-12 19:05:10,988 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:10,988 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75 empty. 2023-07-12 19:05:10,989 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:10,989 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:10,988 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:10,988 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:10,989 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe empty. 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1 empty. 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325 empty. 2023-07-12 19:05:10,990 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72 empty. 2023-07-12 19:05:10,991 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:10,991 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:10,991 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5 empty. 2023-07-12 19:05:10,991 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:10,991 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f empty. 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:10,992 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724 empty. 2023-07-12 19:05:10,993 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f empty. 2023-07-12 19:05:10,993 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:10,993 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:10,993 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:10,995 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756 empty. 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c empty. 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37 empty. 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:10,997 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171 empty. 2023-07-12 19:05:10,998 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:10,998 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:10,998 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true regions 2023-07-12 19:05:11,020 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/.tabledesc/.tableinfo.0000000001 2023-07-12 19:05:11,021 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => f0c0cdd1d4e3b41a353e9f46f7be136f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.', STARTKEY => '', ENDKEY => 'bbb'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,022 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => d553d6a56ac1a02eae16d402efdad87b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b.', STARTKEY => 'bbb', ENDKEY => 'ccc'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,022 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => cb90a60b65f36d3a89e67ce23d6e1791, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791.', STARTKEY => 'ccc', ENDKEY => 'ddd'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 19:05:11,068 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,069 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing d553d6a56ac1a02eae16d402efdad87b, disabling compactions & flushes 2023-07-12 19:05:11,069 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:11,070 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:11,070 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. after waiting 0 ms 2023-07-12 19:05:11,070 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:11,072 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:11,072 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for d553d6a56ac1a02eae16d402efdad87b: 2023-07-12 19:05:11,072 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => a5ff2fcd2829ecc44f00cc2c00bb23ef, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef.', STARTKEY => 'ddd', ENDKEY => 'eee'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,073 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,073 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,073 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing f0c0cdd1d4e3b41a353e9f46f7be136f, disabling compactions & flushes 2023-07-12 19:05:11,073 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing cb90a60b65f36d3a89e67ce23d6e1791, disabling compactions & flushes 2023-07-12 19:05:11,074 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:11,074 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. after waiting 0 ms 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. after waiting 0 ms 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:11,074 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:11,074 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for f0c0cdd1d4e3b41a353e9f46f7be136f: 2023-07-12 19:05:11,074 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for cb90a60b65f36d3a89e67ce23d6e1791: 2023-07-12 19:05:11,075 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => ce7575edbb1d7e25bd4ed4b3e5bec644, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.', STARTKEY => 'eee', ENDKEY => 'fff'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,075 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => eea56a3c84bac34483f036ea38341f7c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c.', STARTKEY => 'fff', ENDKEY => 'ggg'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,110 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,111 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing a5ff2fcd2829ecc44f00cc2c00bb23ef, disabling compactions & flushes 2023-07-12 19:05:11,111 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:05:11,111 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:05:11,111 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. after waiting 0 ms 2023-07-12 19:05:11,111 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:05:11,111 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,111 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:05:11,112 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing ce7575edbb1d7e25bd4ed4b3e5bec644, disabling compactions & flushes 2023-07-12 19:05:11,112 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for a5ff2fcd2829ecc44f00cc2c00bb23ef: 2023-07-12 19:05:11,112 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:05:11,113 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:05:11,113 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. after waiting 0 ms 2023-07-12 19:05:11,113 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:05:11,113 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => c7f9802929d88c18bd6a77756ccfe2c6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6.', STARTKEY => 'ggg', ENDKEY => 'hhh'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,113 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,113 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:05:11,115 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing eea56a3c84bac34483f036ea38341f7c, disabling compactions & flushes 2023-07-12 19:05:11,115 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for ce7575edbb1d7e25bd4ed4b3e5bec644: 2023-07-12 19:05:11,115 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:05:11,116 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:05:11,116 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. after waiting 0 ms 2023-07-12 19:05:11,116 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:05:11,116 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:05:11,116 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for eea56a3c84bac34483f036ea38341f7c: 2023-07-12 19:05:11,116 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 4a0484dfe1e175ac58ae3850727dd3da, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da.', STARTKEY => 'hhh', ENDKEY => 'iii'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,116 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => e088ea3e439d4723be549ccd39a34867, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.', STARTKEY => 'iii', ENDKEY => 'jjj'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,173 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,174 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing c7f9802929d88c18bd6a77756ccfe2c6, disabling compactions & flushes 2023-07-12 19:05:11,174 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:05:11,174 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:05:11,174 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. after waiting 0 ms 2023-07-12 19:05:11,174 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:05:11,174 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:05:11,174 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for c7f9802929d88c18bd6a77756ccfe2c6: 2023-07-12 19:05:11,175 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => cba88346293ad1a9e4c0962a37c6a3a9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9.', STARTKEY => 'jjj', ENDKEY => 'kkk'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,177 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,178 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing e088ea3e439d4723be549ccd39a34867, disabling compactions & flushes 2023-07-12 19:05:11,178 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:05:11,178 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:05:11,178 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. after waiting 0 ms 2023-07-12 19:05:11,178 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:05:11,178 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,178 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:05:11,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 4a0484dfe1e175ac58ae3850727dd3da, disabling compactions & flushes 2023-07-12 19:05:11,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for e088ea3e439d4723be549ccd39a34867: 2023-07-12 19:05:11,179 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:05:11,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:05:11,180 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. after waiting 0 ms 2023-07-12 19:05:11,180 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 138faa52574bb0c1cc404fea49db5c75, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.', STARTKEY => 'kkk', ENDKEY => 'lll'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,180 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:05:11,180 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:05:11,180 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 4a0484dfe1e175ac58ae3850727dd3da: 2023-07-12 19:05:11,181 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => ecd2244642d3eaca1773ab751ae2cf01, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01.', STARTKEY => 'lll', ENDKEY => 'mmm'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,206 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,207 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing cba88346293ad1a9e4c0962a37c6a3a9, disabling compactions & flushes 2023-07-12 19:05:11,207 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:05:11,207 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:05:11,208 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. after waiting 0 ms 2023-07-12 19:05:11,208 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:05:11,208 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:05:11,208 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,208 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for cba88346293ad1a9e4c0962a37c6a3a9: 2023-07-12 19:05:11,210 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 138faa52574bb0c1cc404fea49db5c75, disabling compactions & flushes 2023-07-12 19:05:11,211 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:05:11,211 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:05:11,211 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 857f7f7098ef081088fbf17dc14c7fab, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.', STARTKEY => 'mmm', ENDKEY => 'nnn'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,211 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. after waiting 0 ms 2023-07-12 19:05:11,211 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:05:11,211 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:05:11,211 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 138faa52574bb0c1cc404fea49db5c75: 2023-07-12 19:05:11,212 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => fcabfbbd6b823ca7d698a0d8ec022fe9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9.', STARTKEY => 'nnn', ENDKEY => 'ooo'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,214 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,215 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing ecd2244642d3eaca1773ab751ae2cf01, disabling compactions & flushes 2023-07-12 19:05:11,215 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:05:11,215 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:05:11,216 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. after waiting 0 ms 2023-07-12 19:05:11,216 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:05:11,216 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:05:11,216 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for ecd2244642d3eaca1773ab751ae2cf01: 2023-07-12 19:05:11,217 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 834e5d1c859395db9fa09f16bbadb6fe, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe.', STARTKEY => 'ooo', ENDKEY => 'ppp'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,242 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,243 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing fcabfbbd6b823ca7d698a0d8ec022fe9, disabling compactions & flushes 2023-07-12 19:05:11,243 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:05:11,243 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,243 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 857f7f7098ef081088fbf17dc14c7fab, disabling compactions & flushes 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. after waiting 0 ms 2023-07-12 19:05:11,244 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:05:11,244 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. after waiting 0 ms 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for fcabfbbd6b823ca7d698a0d8ec022fe9: 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:05:11,244 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:05:11,244 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 857f7f7098ef081088fbf17dc14c7fab: 2023-07-12 19:05:11,245 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3932389baa9a41fc2c9f3bd588489325, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325.', STARTKEY => 'qqq', ENDKEY => 'rrr'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,245 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => e07929b49eb60c0014549c0b944194b1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1.', STARTKEY => 'ppp', ENDKEY => 'qqq'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,270 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,270 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing e07929b49eb60c0014549c0b944194b1, disabling compactions & flushes 2023-07-12 19:05:11,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 19:05:11,271 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:05:11,273 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:05:11,273 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. after waiting 0 ms 2023-07-12 19:05:11,273 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:05:11,273 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:05:11,273 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for e07929b49eb60c0014549c0b944194b1: 2023-07-12 19:05:11,273 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 40193bfd281f2b2f7b454fbd94bd1f72, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72.', STARTKEY => 'rrr', ENDKEY => 'sss'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,288 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,288 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 40193bfd281f2b2f7b454fbd94bd1f72, disabling compactions & flushes 2023-07-12 19:05:11,288 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:05:11,288 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:05:11,288 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. after waiting 0 ms 2023-07-12 19:05:11,288 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:05:11,288 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:05:11,288 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 40193bfd281f2b2f7b454fbd94bd1f72: 2023-07-12 19:05:11,289 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9ada7efcd7f8e906f8ea0900275391d5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.', STARTKEY => 'sss', ENDKEY => 'ttt'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,304 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,304 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 9ada7efcd7f8e906f8ea0900275391d5, disabling compactions & flushes 2023-07-12 19:05:11,304 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:05:11,304 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:05:11,304 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. after waiting 0 ms 2023-07-12 19:05:11,304 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:05:11,304 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:05:11,304 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 9ada7efcd7f8e906f8ea0900275391d5: 2023-07-12 19:05:11,305 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a1bb0c5c6eb58e18ca831f4992c1f5f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f.', STARTKEY => 'ttt', ENDKEY => 'uuu'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,318 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,319 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 7a1bb0c5c6eb58e18ca831f4992c1f5f, disabling compactions & flushes 2023-07-12 19:05:11,319 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:05:11,319 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:05:11,319 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. after waiting 0 ms 2023-07-12 19:05:11,319 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:05:11,319 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:05:11,319 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 7a1bb0c5c6eb58e18ca831f4992c1f5f: 2023-07-12 19:05:11,319 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1d3260808db8616b1e8580567e7ef724, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724.', STARTKEY => 'uuu', ENDKEY => 'vvv'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,332 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,332 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 1d3260808db8616b1e8580567e7ef724, disabling compactions & flushes 2023-07-12 19:05:11,332 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:05:11,332 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:05:11,332 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. after waiting 0 ms 2023-07-12 19:05:11,332 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:05:11,332 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:05:11,333 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 1d3260808db8616b1e8580567e7ef724: 2023-07-12 19:05:11,333 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => b33686861752ae5f44ef84731832666f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.', STARTKEY => 'vvv', ENDKEY => 'www'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,348 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,348 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing b33686861752ae5f44ef84731832666f, disabling compactions & flushes 2023-07-12 19:05:11,348 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:05:11,348 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:05:11,348 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. after waiting 0 ms 2023-07-12 19:05:11,348 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:05:11,348 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:05:11,348 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for b33686861752ae5f44ef84731832666f: 2023-07-12 19:05:11,349 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => b9624170c6f0cf6a78f1fab36d60b756, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756.', STARTKEY => 'www', ENDKEY => 'xxx'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,364 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,364 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing b9624170c6f0cf6a78f1fab36d60b756, disabling compactions & flushes 2023-07-12 19:05:11,364 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:05:11,364 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:05:11,364 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. after waiting 0 ms 2023-07-12 19:05:11,364 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:05:11,364 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:05:11,365 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for b9624170c6f0cf6a78f1fab36d60b756: 2023-07-12 19:05:11,365 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 29241abdf5ae1e6c42878fb2f5b4824c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.', STARTKEY => 'xxx', ENDKEY => 'yyy'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 19:05:11,643 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,644 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 834e5d1c859395db9fa09f16bbadb6fe, disabling compactions & flushes 2023-07-12 19:05:11,644 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:05:11,644 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:05:11,644 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. after waiting 0 ms 2023-07-12 19:05:11,644 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:05:11,644 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:05:11,644 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 834e5d1c859395db9fa09f16bbadb6fe: 2023-07-12 19:05:11,644 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => eb958e18b8a10f8d7d64dd6db676c171, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.', STARTKEY => 'yyy', ENDKEY => 'zzz'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,660 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,660 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing eb958e18b8a10f8d7d64dd6db676c171, disabling compactions & flushes 2023-07-12 19:05:11,660 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:05:11,661 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:05:11,661 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. after waiting 0 ms 2023-07-12 19:05:11,661 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:05:11,661 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:05:11,661 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for eb958e18b8a10f8d7d64dd6db676c171: 2023-07-12 19:05:11,661 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 67ebaa1418ea2c26ad1d3745ebac5f37, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37.', STARTKEY => 'zzz', ENDKEY => ''}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/.tmp 2023-07-12 19:05:11,670 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,671 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 3932389baa9a41fc2c9f3bd588489325, disabling compactions & flushes 2023-07-12 19:05:11,671 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:05:11,671 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:05:11,671 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. after waiting 0 ms 2023-07-12 19:05:11,672 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:05:11,672 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:05:11,672 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 3932389baa9a41fc2c9f3bd588489325: 2023-07-12 19:05:11,680 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 67ebaa1418ea2c26ad1d3745ebac5f37, disabling compactions & flushes 2023-07-12 19:05:11,681 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:05:11,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:05:11,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. after waiting 0 ms 2023-07-12 19:05:11,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:05:11,681 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:05:11,682 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 67ebaa1418ea2c26ad1d3745ebac5f37: 2023-07-12 19:05:11,788 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:11,788 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 29241abdf5ae1e6c42878fb2f5b4824c, disabling compactions & flushes 2023-07-12 19:05:11,788 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:05:11,788 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:05:11,788 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. after waiting 0 ms 2023-07-12 19:05:11,788 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:05:11,788 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:05:11,788 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 29241abdf5ae1e6c42878fb2f5b4824c: 2023-07-12 19:05:11,794 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 19:05:11,796 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188711795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689188711795"}]},"ts":"1689188711795"} 2023-07-12 19:05:11,843 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 26 regions to meta. 2023-07-12 19:05:11,845 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 19:05:11,846 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689188711846"}]},"ts":"1689188711846"} 2023-07-12 19:05:11,848 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLING in hbase:meta 2023-07-12 19:05:11,851 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 19:05:11,886 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 19:05:11,886 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 19:05:11,886 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 19:05:11,886 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 19:05:11,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN}, {pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d553d6a56ac1a02eae16d402efdad87b, ASSIGN}, {pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cb90a60b65f36d3a89e67ce23d6e1791, ASSIGN}, {pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a5ff2fcd2829ecc44f00cc2c00bb23ef, ASSIGN}, {pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN}, {pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eea56a3c84bac34483f036ea38341f7c, ASSIGN}, {pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c7f9802929d88c18bd6a77756ccfe2c6, ASSIGN}, {pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4a0484dfe1e175ac58ae3850727dd3da, ASSIGN}, {pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN}, {pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cba88346293ad1a9e4c0962a37c6a3a9, ASSIGN}, {pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN}, {pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecd2244642d3eaca1773ab751ae2cf01, ASSIGN}, {pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN}, {pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fcabfbbd6b823ca7d698a0d8ec022fe9, ASSIGN}, {pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=834e5d1c859395db9fa09f16bbadb6fe, ASSIGN}, {pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e07929b49eb60c0014549c0b944194b1, ASSIGN}, {pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3932389baa9a41fc2c9f3bd588489325, ASSIGN}, {pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=40193bfd281f2b2f7b454fbd94bd1f72, ASSIGN}, {pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN}, {pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=7a1bb0c5c6eb58e18ca831f4992c1f5f, ASSIGN}, {pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1d3260808db8616b1e8580567e7ef724, ASSIGN}, {pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN}, {pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b9624170c6f0cf6a78f1fab36d60b756, ASSIGN}, {pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN}, {pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN}, {pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=67ebaa1418ea2c26ad1d3745ebac5f37, ASSIGN}] 2023-07-12 19:05:11,897 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=67ebaa1418ea2c26ad1d3745ebac5f37, ASSIGN 2023-07-12 19:05:11,899 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=67ebaa1418ea2c26ad1d3745ebac5f37, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,900 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN 2023-07-12 19:05:11,901 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,902 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN 2023-07-12 19:05:11,904 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,905 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b9624170c6f0cf6a78f1fab36d60b756, ASSIGN 2023-07-12 19:05:11,906 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b9624170c6f0cf6a78f1fab36d60b756, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,907 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN 2023-07-12 19:05:11,908 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,909 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1d3260808db8616b1e8580567e7ef724, ASSIGN 2023-07-12 19:05:11,910 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1d3260808db8616b1e8580567e7ef724, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,912 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=7a1bb0c5c6eb58e18ca831f4992c1f5f, ASSIGN 2023-07-12 19:05:11,913 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=7a1bb0c5c6eb58e18ca831f4992c1f5f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,914 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN 2023-07-12 19:05:11,915 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,916 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=40193bfd281f2b2f7b454fbd94bd1f72, ASSIGN 2023-07-12 19:05:11,917 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=40193bfd281f2b2f7b454fbd94bd1f72, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,918 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3932389baa9a41fc2c9f3bd588489325, ASSIGN 2023-07-12 19:05:11,919 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3932389baa9a41fc2c9f3bd588489325, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,920 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e07929b49eb60c0014549c0b944194b1, ASSIGN 2023-07-12 19:05:11,921 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e07929b49eb60c0014549c0b944194b1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,922 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=834e5d1c859395db9fa09f16bbadb6fe, ASSIGN 2023-07-12 19:05:11,923 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=834e5d1c859395db9fa09f16bbadb6fe, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,924 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fcabfbbd6b823ca7d698a0d8ec022fe9, ASSIGN 2023-07-12 19:05:11,925 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fcabfbbd6b823ca7d698a0d8ec022fe9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,926 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN 2023-07-12 19:05:11,927 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,928 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecd2244642d3eaca1773ab751ae2cf01, ASSIGN 2023-07-12 19:05:11,929 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecd2244642d3eaca1773ab751ae2cf01, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,930 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN 2023-07-12 19:05:11,931 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,932 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cba88346293ad1a9e4c0962a37c6a3a9, ASSIGN 2023-07-12 19:05:11,933 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cba88346293ad1a9e4c0962a37c6a3a9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,934 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN 2023-07-12 19:05:11,934 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,936 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4a0484dfe1e175ac58ae3850727dd3da, ASSIGN 2023-07-12 19:05:11,937 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4a0484dfe1e175ac58ae3850727dd3da, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c7f9802929d88c18bd6a77756ccfe2c6, ASSIGN 2023-07-12 19:05:11,939 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c7f9802929d88c18bd6a77756ccfe2c6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,940 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eea56a3c84bac34483f036ea38341f7c, ASSIGN 2023-07-12 19:05:11,941 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eea56a3c84bac34483f036ea38341f7c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,943 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN 2023-07-12 19:05:11,943 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:11,944 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a5ff2fcd2829ecc44f00cc2c00bb23ef, ASSIGN 2023-07-12 19:05:11,945 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a5ff2fcd2829ecc44f00cc2c00bb23ef, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,946 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cb90a60b65f36d3a89e67ce23d6e1791, ASSIGN 2023-07-12 19:05:11,947 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cb90a60b65f36d3a89e67ce23d6e1791, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36833,1689188708236; forceNewPlan=false, retain=false 2023-07-12 19:05:11,948 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d553d6a56ac1a02eae16d402efdad87b, ASSIGN 2023-07-12 19:05:11,949 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d553d6a56ac1a02eae16d402efdad87b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44977,1689188708156; forceNewPlan=false, retain=false 2023-07-12 19:05:11,950 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN 2023-07-12 19:05:11,951 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35281,1689188708201; forceNewPlan=false, retain=false 2023-07-12 19:05:12,049 INFO [jenkins-hbase20:41319] balancer.BaseLoadBalancer(1545): Reassigned 26 regions. 26 retained the pre-restart assignment. 2023-07-12 19:05:12,058 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1d3260808db8616b1e8580567e7ef724, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,058 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712058"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712058"}]},"ts":"1689188712058"} 2023-07-12 19:05:12,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=30, state=RUNNABLE; OpenRegionProcedure 1d3260808db8616b1e8580567e7ef724, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,067 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d553d6a56ac1a02eae16d402efdad87b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,067 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712067"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712067"}]},"ts":"1689188712067"} 2023-07-12 19:05:12,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=11, state=RUNNABLE; OpenRegionProcedure d553d6a56ac1a02eae16d402efdad87b, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712074"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712074"}]},"ts":"1689188712074"} 2023-07-12 19:05:12,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 19:05:12,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=27, state=RUNNABLE; OpenRegionProcedure 40193bfd281f2b2f7b454fbd94bd1f72, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,083 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,083 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188712083"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712083"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712083"}]},"ts":"1689188712083"} 2023-07-12 19:05:12,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=35, state=RUNNABLE; OpenRegionProcedure 67ebaa1418ea2c26ad1d3745ebac5f37, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,091 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,092 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712091"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712091"}]},"ts":"1689188712091"} 2023-07-12 19:05:12,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=23, state=RUNNABLE; OpenRegionProcedure fcabfbbd6b823ca7d698a0d8ec022fe9, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,099 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,100 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712099"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712099"}]},"ts":"1689188712099"} 2023-07-12 19:05:12,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=13, state=RUNNABLE; OpenRegionProcedure a5ff2fcd2829ecc44f00cc2c00bb23ef, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,108 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,108 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712108"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712108"}]},"ts":"1689188712108"} 2023-07-12 19:05:12,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=24, state=RUNNABLE; OpenRegionProcedure 834e5d1c859395db9fa09f16bbadb6fe, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,117 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,117 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712117"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712117"}]},"ts":"1689188712117"} 2023-07-12 19:05:12,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=16, state=RUNNABLE; OpenRegionProcedure c7f9802929d88c18bd6a77756ccfe2c6, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,125 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,126 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712125"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712125"}]},"ts":"1689188712125"} 2023-07-12 19:05:12,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=19, state=RUNNABLE; OpenRegionProcedure cba88346293ad1a9e4c0962a37c6a3a9, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:05:12,134 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,134 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712134"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712134"}]},"ts":"1689188712134"} 2023-07-12 19:05:12,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=29, state=RUNNABLE; OpenRegionProcedure 7a1bb0c5c6eb58e18ca831f4992c1f5f, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,140 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712140"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712140"}]},"ts":"1689188712140"} 2023-07-12 19:05:12,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=12, state=RUNNABLE; OpenRegionProcedure cb90a60b65f36d3a89e67ce23d6e1791, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,146 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=eea56a3c84bac34483f036ea38341f7c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,146 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712146"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712146"}]},"ts":"1689188712146"} 2023-07-12 19:05:12,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=15, state=RUNNABLE; OpenRegionProcedure eea56a3c84bac34483f036ea38341f7c, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=e07929b49eb60c0014549c0b944194b1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,152 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712152"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712152"}]},"ts":"1689188712152"} 2023-07-12 19:05:12,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=25, state=RUNNABLE; OpenRegionProcedure e07929b49eb60c0014549c0b944194b1, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,158 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,159 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712158"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712158"}]},"ts":"1689188712158"} 2023-07-12 19:05:12,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=32, state=RUNNABLE; OpenRegionProcedure b9624170c6f0cf6a78f1fab36d60b756, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,165 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=3932389baa9a41fc2c9f3bd588489325, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,166 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712165"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712165"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712165"}]},"ts":"1689188712165"} 2023-07-12 19:05:12,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=26, state=RUNNABLE; OpenRegionProcedure 3932389baa9a41fc2c9f3bd588489325, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,173 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,173 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712173"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712173"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712173"}]},"ts":"1689188712173"} 2023-07-12 19:05:12,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=17, state=RUNNABLE; OpenRegionProcedure 4a0484dfe1e175ac58ae3850727dd3da, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,179 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,180 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712179"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712179"}]},"ts":"1689188712179"} 2023-07-12 19:05:12,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=21, state=RUNNABLE; OpenRegionProcedure ecd2244642d3eaca1773ab751ae2cf01, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:05:12,185 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=b33686861752ae5f44ef84731832666f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,185 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712185"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712185"}]},"ts":"1689188712185"} 2023-07-12 19:05:12,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=31, state=RUNNABLE; OpenRegionProcedure b33686861752ae5f44ef84731832666f, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,193 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712193"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712193"}]},"ts":"1689188712193"} 2023-07-12 19:05:12,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=34, state=RUNNABLE; OpenRegionProcedure eb958e18b8a10f8d7d64dd6db676c171, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,199 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712199"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712199"}]},"ts":"1689188712199"} 2023-07-12 19:05:12,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=28, state=RUNNABLE; OpenRegionProcedure 9ada7efcd7f8e906f8ea0900275391d5, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,205 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,205 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712204"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712204"}]},"ts":"1689188712204"} 2023-07-12 19:05:12,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=33, state=RUNNABLE; OpenRegionProcedure 29241abdf5ae1e6c42878fb2f5b4824c, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,211 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e088ea3e439d4723be549ccd39a34867, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,211 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712210"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712210"}]},"ts":"1689188712210"} 2023-07-12 19:05:12,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=18, state=RUNNABLE; OpenRegionProcedure e088ea3e439d4723be549ccd39a34867, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,215 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,215 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 19:05:12,219 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 19:05:12,219 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=138faa52574bb0c1cc404fea49db5c75, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,220 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712219"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712219"}]},"ts":"1689188712219"} 2023-07-12 19:05:12,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=20, state=RUNNABLE; OpenRegionProcedure 138faa52574bb0c1cc404fea49db5c75, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:05:12,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1d3260808db8616b1e8580567e7ef724, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-12 19:05:12,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,228 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=857f7f7098ef081088fbf17dc14c7fab, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,228 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712228"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712228"}]},"ts":"1689188712228"} 2023-07-12 19:05:12,229 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=59, ppid=22, state=RUNNABLE; OpenRegionProcedure 857f7f7098ef081088fbf17dc14c7fab, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,231 DEBUG [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily11 2023-07-12 19:05:12,231 DEBUG [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily11 2023-07-12 19:05:12,232 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d3260808db8616b1e8580567e7ef724 columnFamilyName colfamily11 2023-07-12 19:05:12,233 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] regionserver.HStore(310): Store=1d3260808db8616b1e8580567e7ef724/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,233 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,235 DEBUG [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily21 2023-07-12 19:05:12,235 DEBUG [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily21 2023-07-12 19:05:12,236 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,237 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712235"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712235"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712235"}]},"ts":"1689188712235"} 2023-07-12 19:05:12,237 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d3260808db8616b1e8580567e7ef724 columnFamilyName colfamily21 2023-07-12 19:05:12,237 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] regionserver.HStore(310): Store=1d3260808db8616b1e8580567e7ef724/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,238 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=14, state=RUNNABLE; OpenRegionProcedure ce7575edbb1d7e25bd4ed4b3e5bec644, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,241 DEBUG [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily31 2023-07-12 19:05:12,241 DEBUG [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily31 2023-07-12 19:05:12,242 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d3260808db8616b1e8580567e7ef724 columnFamilyName colfamily31 2023-07-12 19:05:12,242 INFO [StoreOpener-1d3260808db8616b1e8580567e7ef724-1] regionserver.HStore(310): Store=1d3260808db8616b1e8580567e7ef724/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,246 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,246 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188712246"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188712246"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188712246"}]},"ts":"1689188712246"} 2023-07-12 19:05:12,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=10, state=RUNNABLE; OpenRegionProcedure f0c0cdd1d4e3b41a353e9f46f7be136f, server=jenkins-hbase20.apache.org,35281,1689188708201}] 2023-07-12 19:05:12,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:05:12,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1d3260808db8616b1e8580567e7ef724; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72184920, jitterRate=0.07563912868499756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1d3260808db8616b1e8580567e7ef724: 2023-07-12 19:05:12,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724., pid=36, masterSystemTime=1689188712215 2023-07-12 19:05:12,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:05:12,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:05:12,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:05:12,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fcabfbbd6b823ca7d698a0d8ec022fe9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-12 19:05:12,267 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1d3260808db8616b1e8580567e7ef724, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,267 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712267"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712267"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712267"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712267"}]},"ts":"1689188712267"} 2023-07-12 19:05:12,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,269 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,273 DEBUG [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily11 2023-07-12 19:05:12,273 DEBUG [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily11 2023-07-12 19:05:12,274 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcabfbbd6b823ca7d698a0d8ec022fe9 columnFamilyName colfamily11 2023-07-12 19:05:12,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=30 2023-07-12 19:05:12,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=30, state=SUCCESS; OpenRegionProcedure 1d3260808db8616b1e8580567e7ef724, server=jenkins-hbase20.apache.org,44977,1689188708156 in 210 msec 2023-07-12 19:05:12,275 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] regionserver.HStore(310): Store=fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,277 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1d3260808db8616b1e8580567e7ef724, ASSIGN in 387 msec 2023-07-12 19:05:12,280 DEBUG [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily21 2023-07-12 19:05:12,280 DEBUG [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily21 2023-07-12 19:05:12,281 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcabfbbd6b823ca7d698a0d8ec022fe9 columnFamilyName colfamily21 2023-07-12 19:05:12,282 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] regionserver.HStore(310): Store=fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,282 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,284 DEBUG [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily31 2023-07-12 19:05:12,285 DEBUG [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily31 2023-07-12 19:05:12,285 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcabfbbd6b823ca7d698a0d8ec022fe9 columnFamilyName colfamily31 2023-07-12 19:05:12,286 INFO [StoreOpener-fcabfbbd6b823ca7d698a0d8ec022fe9-1] regionserver.HStore(310): Store=fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,290 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,290 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 19:05:12,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,293 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 19:05:12,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:05:12,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:05:12,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9624170c6f0cf6a78f1fab36d60b756, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-12 19:05:12,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,303 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,305 DEBUG [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily11 2023-07-12 19:05:12,305 DEBUG [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily11 2023-07-12 19:05:12,305 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9624170c6f0cf6a78f1fab36d60b756 columnFamilyName colfamily11 2023-07-12 19:05:12,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fcabfbbd6b823ca7d698a0d8ec022fe9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74583140, jitterRate=0.11137539148330688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fcabfbbd6b823ca7d698a0d8ec022fe9: 2023-07-12 19:05:12,306 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] regionserver.HStore(310): Store=b9624170c6f0cf6a78f1fab36d60b756/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,306 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9., pid=40, masterSystemTime=1689188712215 2023-07-12 19:05:12,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:05:12,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:05:12,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:12,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d553d6a56ac1a02eae16d402efdad87b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-12 19:05:12,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,310 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,310 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712310"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712310"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712310"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712310"}]},"ts":"1689188712310"} 2023-07-12 19:05:12,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,312 DEBUG [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily21 2023-07-12 19:05:12,313 DEBUG [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily21 2023-07-12 19:05:12,314 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,315 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9624170c6f0cf6a78f1fab36d60b756 columnFamilyName colfamily21 2023-07-12 19:05:12,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=23 2023-07-12 19:05:12,317 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] regionserver.HStore(310): Store=b9624170c6f0cf6a78f1fab36d60b756/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=23, state=SUCCESS; OpenRegionProcedure fcabfbbd6b823ca7d698a0d8ec022fe9, server=jenkins-hbase20.apache.org,44977,1689188708156 in 219 msec 2023-07-12 19:05:12,317 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,318 DEBUG [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily11 2023-07-12 19:05:12,318 DEBUG [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily11 2023-07-12 19:05:12,319 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d553d6a56ac1a02eae16d402efdad87b columnFamilyName colfamily11 2023-07-12 19:05:12,320 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] regionserver.HStore(310): Store=d553d6a56ac1a02eae16d402efdad87b/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fcabfbbd6b823ca7d698a0d8ec022fe9, ASSIGN in 431 msec 2023-07-12 19:05:12,320 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,320 DEBUG [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily31 2023-07-12 19:05:12,320 DEBUG [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily31 2023-07-12 19:05:12,321 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9624170c6f0cf6a78f1fab36d60b756 columnFamilyName colfamily31 2023-07-12 19:05:12,322 INFO [StoreOpener-b9624170c6f0cf6a78f1fab36d60b756-1] regionserver.HStore(310): Store=b9624170c6f0cf6a78f1fab36d60b756/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,322 DEBUG [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily21 2023-07-12 19:05:12,322 DEBUG [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily21 2023-07-12 19:05:12,323 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d553d6a56ac1a02eae16d402efdad87b columnFamilyName colfamily21 2023-07-12 19:05:12,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,324 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] regionserver.HStore(310): Store=d553d6a56ac1a02eae16d402efdad87b/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,324 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,326 DEBUG [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily31 2023-07-12 19:05:12,326 DEBUG [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily31 2023-07-12 19:05:12,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,327 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d553d6a56ac1a02eae16d402efdad87b columnFamilyName colfamily31 2023-07-12 19:05:12,327 INFO [StoreOpener-d553d6a56ac1a02eae16d402efdad87b-1] regionserver.HStore(310): Store=d553d6a56ac1a02eae16d402efdad87b/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:05:12,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b9624170c6f0cf6a78f1fab36d60b756; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66839816, jitterRate=-0.004009127616882324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b9624170c6f0cf6a78f1fab36d60b756: 2023-07-12 19:05:12,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756., pid=49, masterSystemTime=1689188712290 2023-07-12 19:05:12,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:05:12,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:05:12,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:05:12,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:05:12,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a1bb0c5c6eb58e18ca831f4992c1f5f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-12 19:05:12,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,346 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,346 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712346"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712346"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712346"}]},"ts":"1689188712346"} 2023-07-12 19:05:12,347 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,349 DEBUG [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily11 2023-07-12 19:05:12,350 DEBUG [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily11 2023-07-12 19:05:12,350 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a1bb0c5c6eb58e18ca831f4992c1f5f columnFamilyName colfamily11 2023-07-12 19:05:12,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:05:12,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e088ea3e439d4723be549ccd39a34867, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-12 19:05:12,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,355 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] regionserver.HStore(310): Store=7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,355 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d553d6a56ac1a02eae16d402efdad87b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66211610, jitterRate=-0.013370126485824585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d553d6a56ac1a02eae16d402efdad87b: 2023-07-12 19:05:12,358 DEBUG [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily21 2023-07-12 19:05:12,358 DEBUG [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily21 2023-07-12 19:05:12,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b., pid=37, masterSystemTime=1689188712215 2023-07-12 19:05:12,359 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a1bb0c5c6eb58e18ca831f4992c1f5f columnFamilyName colfamily21 2023-07-12 19:05:12,360 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] regionserver.HStore(310): Store=7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,361 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=32 2023-07-12 19:05:12,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=32, state=SUCCESS; OpenRegionProcedure b9624170c6f0cf6a78f1fab36d60b756, server=jenkins-hbase20.apache.org,36833,1689188708236 in 194 msec 2023-07-12 19:05:12,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:12,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:12,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:05:12,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 834e5d1c859395db9fa09f16bbadb6fe, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2023-07-12 19:05:12,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b9624170c6f0cf6a78f1fab36d60b756, ASSIGN in 473 msec 2023-07-12 19:05:12,365 DEBUG [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily31 2023-07-12 19:05:12,365 DEBUG [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily31 2023-07-12 19:05:12,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d553d6a56ac1a02eae16d402efdad87b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712365"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712365"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712365"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712365"}]},"ts":"1689188712365"} 2023-07-12 19:05:12,366 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a1bb0c5c6eb58e18ca831f4992c1f5f columnFamilyName colfamily31 2023-07-12 19:05:12,368 INFO [StoreOpener-7a1bb0c5c6eb58e18ca831f4992c1f5f-1] regionserver.HStore(310): Store=7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,368 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,372 DEBUG [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily11 2023-07-12 19:05:12,373 DEBUG [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily11 2023-07-12 19:05:12,374 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 834e5d1c859395db9fa09f16bbadb6fe columnFamilyName colfamily11 2023-07-12 19:05:12,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=11 2023-07-12 19:05:12,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=11, state=SUCCESS; OpenRegionProcedure d553d6a56ac1a02eae16d402efdad87b, server=jenkins-hbase20.apache.org,44977,1689188708156 in 301 msec 2023-07-12 19:05:12,366 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,375 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] regionserver.HStore(310): Store=834e5d1c859395db9fa09f16bbadb6fe/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,375 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,378 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily11 2023-07-12 19:05:12,378 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily11 2023-07-12 19:05:12,379 DEBUG [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily21 2023-07-12 19:05:12,379 DEBUG [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily21 2023-07-12 19:05:12,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:05:12,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d553d6a56ac1a02eae16d402efdad87b, ASSIGN in 487 msec 2023-07-12 19:05:12,380 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e088ea3e439d4723be549ccd39a34867 columnFamilyName colfamily11 2023-07-12 19:05:12,380 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 834e5d1c859395db9fa09f16bbadb6fe columnFamilyName colfamily21 2023-07-12 19:05:12,380 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(310): Store=e088ea3e439d4723be549ccd39a34867/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,381 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] regionserver.HStore(310): Store=834e5d1c859395db9fa09f16bbadb6fe/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,381 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,381 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,383 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily21 2023-07-12 19:05:12,383 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily21 2023-07-12 19:05:12,383 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e088ea3e439d4723be549ccd39a34867 columnFamilyName colfamily21 2023-07-12 19:05:12,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,384 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(310): Store=e088ea3e439d4723be549ccd39a34867/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,384 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,384 DEBUG [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily31 2023-07-12 19:05:12,385 DEBUG [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily31 2023-07-12 19:05:12,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7a1bb0c5c6eb58e18ca831f4992c1f5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73585941, jitterRate=0.0965159684419632}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7a1bb0c5c6eb58e18ca831f4992c1f5f: 2023-07-12 19:05:12,387 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 834e5d1c859395db9fa09f16bbadb6fe columnFamilyName colfamily31 2023-07-12 19:05:12,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f., pid=45, masterSystemTime=1689188712290 2023-07-12 19:05:12,387 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily31 2023-07-12 19:05:12,387 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily31 2023-07-12 19:05:12,388 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e088ea3e439d4723be549ccd39a34867 columnFamilyName colfamily31 2023-07-12 19:05:12,389 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(310): Store=e088ea3e439d4723be549ccd39a34867/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,389 INFO [StoreOpener-834e5d1c859395db9fa09f16bbadb6fe-1] regionserver.HStore(310): Store=834e5d1c859395db9fa09f16bbadb6fe/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:05:12,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:05:12,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:12,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb90a60b65f36d3a89e67ce23d6e1791, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-12 19:05:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,394 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712394"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712394"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712394"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712394"}]},"ts":"1689188712394"} 2023-07-12 19:05:12,396 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,399 DEBUG [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily11 2023-07-12 19:05:12,399 DEBUG [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily11 2023-07-12 19:05:12,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e088ea3e439d4723be549ccd39a34867 2023-07-12 19:05:12,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:05:12,400 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb90a60b65f36d3a89e67ce23d6e1791 columnFamilyName colfamily11 2023-07-12 19:05:12,402 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] regionserver.HStore(310): Store=cb90a60b65f36d3a89e67ce23d6e1791/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,402 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=29 2023-07-12 19:05:12,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=29, state=SUCCESS; OpenRegionProcedure 7a1bb0c5c6eb58e18ca831f4992c1f5f, server=jenkins-hbase20.apache.org,36833,1689188708236 in 261 msec 2023-07-12 19:05:12,406 DEBUG [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily21 2023-07-12 19:05:12,406 DEBUG [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily21 2023-07-12 19:05:12,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 834e5d1c859395db9fa09f16bbadb6fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74738986, jitterRate=0.11369767785072327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 834e5d1c859395db9fa09f16bbadb6fe: 2023-07-12 19:05:12,409 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb90a60b65f36d3a89e67ce23d6e1791 columnFamilyName colfamily21 2023-07-12 19:05:12,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=7a1bb0c5c6eb58e18ca831f4992c1f5f, ASSIGN in 517 msec 2023-07-12 19:05:12,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe., pid=42, masterSystemTime=1689188712215 2023-07-12 19:05:12,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e088ea3e439d4723be549ccd39a34867; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59032115, jitterRate=-0.12035293877124786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e088ea3e439d4723be549ccd39a34867: 2023-07-12 19:05:12,410 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] regionserver.HStore(310): Store=cb90a60b65f36d3a89e67ce23d6e1791/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,411 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867., pid=57, masterSystemTime=1689188712341 2023-07-12 19:05:12,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:05:12,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:05:12,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:05:12,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 40193bfd281f2b2f7b454fbd94bd1f72, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2023-07-12 19:05:12,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,415 DEBUG [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily31 2023-07-12 19:05:12,415 DEBUG [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily31 2023-07-12 19:05:12,415 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb90a60b65f36d3a89e67ce23d6e1791 columnFamilyName colfamily31 2023-07-12 19:05:12,416 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,416 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712416"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712416"}]},"ts":"1689188712416"} 2023-07-12 19:05:12,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:05:12,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:05:12,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:05:12,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ada7efcd7f8e906f8ea0900275391d5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-12 19:05:12,417 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,421 DEBUG [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily11 2023-07-12 19:05:12,421 DEBUG [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily11 2023-07-12 19:05:12,422 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40193bfd281f2b2f7b454fbd94bd1f72 columnFamilyName colfamily11 2023-07-12 19:05:12,422 INFO [StoreOpener-cb90a60b65f36d3a89e67ce23d6e1791-1] regionserver.HStore(310): Store=cb90a60b65f36d3a89e67ce23d6e1791/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,423 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] regionserver.HStore(310): Store=40193bfd281f2b2f7b454fbd94bd1f72/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,423 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=24 2023-07-12 19:05:12,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=24, state=SUCCESS; OpenRegionProcedure 834e5d1c859395db9fa09f16bbadb6fe, server=jenkins-hbase20.apache.org,44977,1689188708156 in 308 msec 2023-07-12 19:05:12,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=834e5d1c859395db9fa09f16bbadb6fe, ASSIGN in 537 msec 2023-07-12 19:05:12,426 DEBUG [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily21 2023-07-12 19:05:12,426 DEBUG [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily21 2023-07-12 19:05:12,427 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,427 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40193bfd281f2b2f7b454fbd94bd1f72 columnFamilyName colfamily21 2023-07-12 19:05:12,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,430 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] regionserver.HStore(310): Store=40193bfd281f2b2f7b454fbd94bd1f72/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,430 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712430"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712430"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712430"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712430"}]},"ts":"1689188712430"} 2023-07-12 19:05:12,432 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily11 2023-07-12 19:05:12,432 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily11 2023-07-12 19:05:12,433 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ada7efcd7f8e906f8ea0900275391d5 columnFamilyName colfamily11 2023-07-12 19:05:12,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,434 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(310): Store=9ada7efcd7f8e906f8ea0900275391d5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,435 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,435 DEBUG [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily31 2023-07-12 19:05:12,435 DEBUG [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily31 2023-07-12 19:05:12,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:05:12,436 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40193bfd281f2b2f7b454fbd94bd1f72 columnFamilyName colfamily31 2023-07-12 19:05:12,438 INFO [StoreOpener-40193bfd281f2b2f7b454fbd94bd1f72-1] regionserver.HStore(310): Store=40193bfd281f2b2f7b454fbd94bd1f72/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,439 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily21 2023-07-12 19:05:12,440 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily21 2023-07-12 19:05:12,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,441 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ada7efcd7f8e906f8ea0900275391d5 columnFamilyName colfamily21 2023-07-12 19:05:12,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=18 2023-07-12 19:05:12,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=18, state=SUCCESS; OpenRegionProcedure e088ea3e439d4723be549ccd39a34867, server=jenkins-hbase20.apache.org,35281,1689188708201 in 222 msec 2023-07-12 19:05:12,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,443 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(310): Store=9ada7efcd7f8e906f8ea0900275391d5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cb90a60b65f36d3a89e67ce23d6e1791; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60054777, jitterRate=-0.10511408746242523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cb90a60b65f36d3a89e67ce23d6e1791: 2023-07-12 19:05:12,445 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791., pid=46, masterSystemTime=1689188712290 2023-07-12 19:05:12,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN in 555 msec 2023-07-12 19:05:12,449 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily31 2023-07-12 19:05:12,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:12,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:05:12,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:12,450 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily31 2023-07-12 19:05:12,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:05:12,450 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eea56a3c84bac34483f036ea38341f7c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2023-07-12 19:05:12,450 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712450"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712450"}]},"ts":"1689188712450"} 2023-07-12 19:05:12,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,456 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ada7efcd7f8e906f8ea0900275391d5 columnFamilyName colfamily31 2023-07-12 19:05:12,457 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(310): Store=9ada7efcd7f8e906f8ea0900275391d5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=12 2023-07-12 19:05:12,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=12, state=SUCCESS; OpenRegionProcedure cb90a60b65f36d3a89e67ce23d6e1791, server=jenkins-hbase20.apache.org,36833,1689188708236 in 311 msec 2023-07-12 19:05:12,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cb90a60b65f36d3a89e67ce23d6e1791, ASSIGN in 571 msec 2023-07-12 19:05:12,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,464 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 40193bfd281f2b2f7b454fbd94bd1f72; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66671647, jitterRate=-0.006515040993690491}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 40193bfd281f2b2f7b454fbd94bd1f72: 2023-07-12 19:05:12,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72., pid=38, masterSystemTime=1689188712215 2023-07-12 19:05:12,468 DEBUG [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily11 2023-07-12 19:05:12,468 DEBUG [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily11 2023-07-12 19:05:12,469 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eea56a3c84bac34483f036ea38341f7c columnFamilyName colfamily11 2023-07-12 19:05:12,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:05:12,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:05:12,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:05:12,470 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] regionserver.HStore(310): Store=eea56a3c84bac34483f036ea38341f7c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cba88346293ad1a9e4c0962a37c6a3a9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-12 19:05:12,470 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,472 DEBUG [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily21 2023-07-12 19:05:12,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:05:12,472 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,472 DEBUG [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily21 2023-07-12 19:05:12,473 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eea56a3c84bac34483f036ea38341f7c columnFamilyName colfamily21 2023-07-12 19:05:12,474 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,474 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712474"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712474"}]},"ts":"1689188712474"} 2023-07-12 19:05:12,474 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] regionserver.HStore(310): Store=eea56a3c84bac34483f036ea38341f7c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,475 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,477 DEBUG [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily31 2023-07-12 19:05:12,477 DEBUG [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily31 2023-07-12 19:05:12,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,478 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eea56a3c84bac34483f036ea38341f7c columnFamilyName colfamily31 2023-07-12 19:05:12,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9ada7efcd7f8e906f8ea0900275391d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58812678, jitterRate=-0.12362280488014221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9ada7efcd7f8e906f8ea0900275391d5: 2023-07-12 19:05:12,479 DEBUG [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily11 2023-07-12 19:05:12,479 DEBUG [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily11 2023-07-12 19:05:12,480 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cba88346293ad1a9e4c0962a37c6a3a9 columnFamilyName colfamily11 2023-07-12 19:05:12,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5., pid=55, masterSystemTime=1689188712341 2023-07-12 19:05:12,480 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] regionserver.HStore(310): Store=cba88346293ad1a9e4c0962a37c6a3a9/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,481 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,482 DEBUG [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily21 2023-07-12 19:05:12,483 DEBUG [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily21 2023-07-12 19:05:12,483 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cba88346293ad1a9e4c0962a37c6a3a9 columnFamilyName colfamily21 2023-07-12 19:05:12,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:05:12,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:05:12,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:05:12,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce7575edbb1d7e25bd4ed4b3e5bec644, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-12 19:05:12,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=27 2023-07-12 19:05:12,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=27, state=SUCCESS; OpenRegionProcedure 40193bfd281f2b2f7b454fbd94bd1f72, server=jenkins-hbase20.apache.org,44977,1689188708156 in 400 msec 2023-07-12 19:05:12,486 INFO [StoreOpener-eea56a3c84bac34483f036ea38341f7c-1] regionserver.HStore(310): Store=eea56a3c84bac34483f036ea38341f7c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,487 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] regionserver.HStore(310): Store=cba88346293ad1a9e4c0962a37c6a3a9/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,487 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,489 DEBUG [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily31 2023-07-12 19:05:12,489 DEBUG [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily31 2023-07-12 19:05:12,490 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cba88346293ad1a9e4c0962a37c6a3a9 columnFamilyName colfamily31 2023-07-12 19:05:12,491 INFO [StoreOpener-cba88346293ad1a9e4c0962a37c6a3a9-1] regionserver.HStore(310): Store=cba88346293ad1a9e4c0962a37c6a3a9/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=40193bfd281f2b2f7b454fbd94bd1f72, ASSIGN in 599 msec 2023-07-12 19:05:12,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,494 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,494 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712494"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712494"}]},"ts":"1689188712494"} 2023-07-12 19:05:12,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:05:12,499 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened eea56a3c84bac34483f036ea38341f7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59419804, jitterRate=-0.11457592248916626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for eea56a3c84bac34483f036ea38341f7c: 2023-07-12 19:05:12,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c., pid=47, masterSystemTime=1689188712290 2023-07-12 19:05:12,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=28 2023-07-12 19:05:12,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:05:12,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=28, state=SUCCESS; OpenRegionProcedure 9ada7efcd7f8e906f8ea0900275391d5, server=jenkins-hbase20.apache.org,35281,1689188708201 in 302 msec 2023-07-12 19:05:12,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:05:12,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:05:12,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:05:12,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a0484dfe1e175ac58ae3850727dd3da, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2023-07-12 19:05:12,511 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=eea56a3c84bac34483f036ea38341f7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,511 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712511"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712511"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712511"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712511"}]},"ts":"1689188712511"} 2023-07-12 19:05:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,514 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cba88346293ad1a9e4c0962a37c6a3a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65265371, jitterRate=-0.027470186352729797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cba88346293ad1a9e4c0962a37c6a3a9: 2023-07-12 19:05:12,516 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11 2023-07-12 19:05:12,516 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11 2023-07-12 19:05:12,517 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce7575edbb1d7e25bd4ed4b3e5bec644 columnFamilyName colfamily11 2023-07-12 19:05:12,518 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(310): Store=ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,518 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9., pid=44, masterSystemTime=1689188712215 2023-07-12 19:05:12,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=15 2023-07-12 19:05:12,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=15, state=SUCCESS; OpenRegionProcedure eea56a3c84bac34483f036ea38341f7c, server=jenkins-hbase20.apache.org,36833,1689188708236 in 366 msec 2023-07-12 19:05:12,519 DEBUG [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily11 2023-07-12 19:05:12,519 DEBUG [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily11 2023-07-12 19:05:12,520 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a0484dfe1e175ac58ae3850727dd3da columnFamilyName colfamily11 2023-07-12 19:05:12,520 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily21 2023-07-12 19:05:12,521 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily21 2023-07-12 19:05:12,521 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce7575edbb1d7e25bd4ed4b3e5bec644 columnFamilyName colfamily21 2023-07-12 19:05:12,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:05:12,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:05:12,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:05:12,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5ff2fcd2829ecc44f00cc2c00bb23ef, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-12 19:05:12,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,522 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(310): Store=ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,522 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eea56a3c84bac34483f036ea38341f7c, ASSIGN in 632 msec 2023-07-12 19:05:12,523 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] regionserver.HStore(310): Store=4a0484dfe1e175ac58ae3850727dd3da/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,524 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,525 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily31 2023-07-12 19:05:12,525 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily31 2023-07-12 19:05:12,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,526 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712525"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712525"}]},"ts":"1689188712525"} 2023-07-12 19:05:12,526 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce7575edbb1d7e25bd4ed4b3e5bec644 columnFamilyName colfamily31 2023-07-12 19:05:12,527 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(310): Store=ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,527 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,532 DEBUG [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily21 2023-07-12 19:05:12,532 DEBUG [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily21 2023-07-12 19:05:12,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,533 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a0484dfe1e175ac58ae3850727dd3da columnFamilyName colfamily21 2023-07-12 19:05:12,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,534 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] regionserver.HStore(310): Store=4a0484dfe1e175ac58ae3850727dd3da/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,534 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,534 DEBUG [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily11 2023-07-12 19:05:12,534 DEBUG [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily11 2023-07-12 19:05:12,535 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5ff2fcd2829ecc44f00cc2c00bb23ef columnFamilyName colfamily11 2023-07-12 19:05:12,536 DEBUG [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily31 2023-07-12 19:05:12,537 DEBUG [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily31 2023-07-12 19:05:12,537 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] regionserver.HStore(310): Store=a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,537 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a0484dfe1e175ac58ae3850727dd3da columnFamilyName colfamily31 2023-07-12 19:05:12,539 INFO [StoreOpener-4a0484dfe1e175ac58ae3850727dd3da-1] regionserver.HStore(310): Store=4a0484dfe1e175ac58ae3850727dd3da/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,537 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=19 2023-07-12 19:05:12,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=19, state=SUCCESS; OpenRegionProcedure cba88346293ad1a9e4c0962a37c6a3a9, server=jenkins-hbase20.apache.org,44977,1689188708156 in 406 msec 2023-07-12 19:05:12,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:05:12,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cba88346293ad1a9e4c0962a37c6a3a9, ASSIGN in 653 msec 2023-07-12 19:05:12,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ce7575edbb1d7e25bd4ed4b3e5bec644; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62006696, jitterRate=-0.07602822780609131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ce7575edbb1d7e25bd4ed4b3e5bec644: 2023-07-12 19:05:12,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644., pid=60, masterSystemTime=1689188712341 2023-07-12 19:05:12,549 DEBUG [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily21 2023-07-12 19:05:12,549 DEBUG [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily21 2023-07-12 19:05:12,550 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5ff2fcd2829ecc44f00cc2c00bb23ef columnFamilyName colfamily21 2023-07-12 19:05:12,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN in 656 msec 2023-07-12 19:05:12,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:05:12,551 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] regionserver.HStore(310): Store=a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,551 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:05:12,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:05:12,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:05:12,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 29241abdf5ae1e6c42878fb2f5b4824c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-12 19:05:12,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,554 DEBUG [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily31 2023-07-12 19:05:12,555 DEBUG [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily31 2023-07-12 19:05:12,555 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5ff2fcd2829ecc44f00cc2c00bb23ef columnFamilyName colfamily31 2023-07-12 19:05:12,556 INFO [StoreOpener-a5ff2fcd2829ecc44f00cc2c00bb23ef-1] regionserver.HStore(310): Store=a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712557"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712557"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712557"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712557"}]},"ts":"1689188712557"} 2023-07-12 19:05:12,565 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,567 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily11 2023-07-12 19:05:12,567 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily11 2023-07-12 19:05:12,568 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29241abdf5ae1e6c42878fb2f5b4824c columnFamilyName colfamily11 2023-07-12 19:05:12,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4a0484dfe1e175ac58ae3850727dd3da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63895352, jitterRate=-0.04788506031036377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4a0484dfe1e175ac58ae3850727dd3da: 2023-07-12 19:05:12,569 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(310): Store=29241abdf5ae1e6c42878fb2f5b4824c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,569 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da., pid=51, masterSystemTime=1689188712290 2023-07-12 19:05:12,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,572 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily21 2023-07-12 19:05:12,572 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily21 2023-07-12 19:05:12,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:05:12,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:05:12,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:05:12,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:05:12,574 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29241abdf5ae1e6c42878fb2f5b4824c columnFamilyName colfamily21 2023-07-12 19:05:12,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e07929b49eb60c0014549c0b944194b1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-12 19:05:12,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=14 2023-07-12 19:05:12,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=14, state=SUCCESS; OpenRegionProcedure ce7575edbb1d7e25bd4ed4b3e5bec644, server=jenkins-hbase20.apache.org,35281,1689188708201 in 330 msec 2023-07-12 19:05:12,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,575 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(310): Store=29241abdf5ae1e6c42878fb2f5b4824c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,575 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN in 688 msec 2023-07-12 19:05:12,579 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,579 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712579"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712579"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712579"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712579"}]},"ts":"1689188712579"} 2023-07-12 19:05:12,582 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily31 2023-07-12 19:05:12,583 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily31 2023-07-12 19:05:12,583 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,584 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29241abdf5ae1e6c42878fb2f5b4824c columnFamilyName colfamily31 2023-07-12 19:05:12,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a5ff2fcd2829ecc44f00cc2c00bb23ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60245831, jitterRate=-0.10226716101169586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a5ff2fcd2829ecc44f00cc2c00bb23ef: 2023-07-12 19:05:12,585 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(310): Store=29241abdf5ae1e6c42878fb2f5b4824c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef., pid=41, masterSystemTime=1689188712215 2023-07-12 19:05:12,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,589 DEBUG [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily11 2023-07-12 19:05:12,589 DEBUG [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily11 2023-07-12 19:05:12,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=17 2023-07-12 19:05:12,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=17, state=SUCCESS; OpenRegionProcedure 4a0484dfe1e175ac58ae3850727dd3da, server=jenkins-hbase20.apache.org,36833,1689188708236 in 407 msec 2023-07-12 19:05:12,590 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e07929b49eb60c0014549c0b944194b1 columnFamilyName colfamily11 2023-07-12 19:05:12,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:05:12,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:05:12,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:05:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67ebaa1418ea2c26ad1d3745ebac5f37, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-12 19:05:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,592 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] regionserver.HStore(310): Store=e07929b49eb60c0014549c0b944194b1/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,592 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4a0484dfe1e175ac58ae3850727dd3da, ASSIGN in 703 msec 2023-07-12 19:05:12,594 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:05:12,594 DEBUG [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily21 2023-07-12 19:05:12,594 DEBUG [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily21 2023-07-12 19:05:12,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,595 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e07929b49eb60c0014549c0b944194b1 columnFamilyName colfamily21 2023-07-12 19:05:12,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712594"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712594"}]},"ts":"1689188712594"} 2023-07-12 19:05:12,596 DEBUG [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily11 2023-07-12 19:05:12,596 DEBUG [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily11 2023-07-12 19:05:12,597 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67ebaa1418ea2c26ad1d3745ebac5f37 columnFamilyName colfamily11 2023-07-12 19:05:12,597 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] regionserver.HStore(310): Store=e07929b49eb60c0014549c0b944194b1/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,597 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,599 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] regionserver.HStore(310): Store=67ebaa1418ea2c26ad1d3745ebac5f37/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,599 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,600 DEBUG [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily31 2023-07-12 19:05:12,600 DEBUG [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily31 2023-07-12 19:05:12,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 29241abdf5ae1e6c42878fb2f5b4824c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68609725, jitterRate=0.022364571690559387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 29241abdf5ae1e6c42878fb2f5b4824c: 2023-07-12 19:05:12,601 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e07929b49eb60c0014549c0b944194b1 columnFamilyName colfamily31 2023-07-12 19:05:12,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c., pid=56, masterSystemTime=1689188712341 2023-07-12 19:05:12,602 INFO [StoreOpener-e07929b49eb60c0014549c0b944194b1-1] regionserver.HStore(310): Store=e07929b49eb60c0014549c0b944194b1/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,604 DEBUG [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily21 2023-07-12 19:05:12,604 DEBUG [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily21 2023-07-12 19:05:12,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:05:12,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:05:12,605 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67ebaa1418ea2c26ad1d3745ebac5f37 columnFamilyName colfamily21 2023-07-12 19:05:12,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=13 2023-07-12 19:05:12,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:05:12,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=13, state=SUCCESS; OpenRegionProcedure a5ff2fcd2829ecc44f00cc2c00bb23ef, server=jenkins-hbase20.apache.org,44977,1689188708156 in 496 msec 2023-07-12 19:05:12,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 857f7f7098ef081088fbf17dc14c7fab, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-12 19:05:12,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,607 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] regionserver.HStore(310): Store=67ebaa1418ea2c26ad1d3745ebac5f37/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,608 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a5ff2fcd2829ecc44f00cc2c00bb23ef, ASSIGN in 719 msec 2023-07-12 19:05:12,610 DEBUG [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily31 2023-07-12 19:05:12,611 DEBUG [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily31 2023-07-12 19:05:12,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,611 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67ebaa1418ea2c26ad1d3745ebac5f37 columnFamilyName colfamily31 2023-07-12 19:05:12,612 INFO [StoreOpener-67ebaa1418ea2c26ad1d3745ebac5f37-1] regionserver.HStore(310): Store=67ebaa1418ea2c26ad1d3745ebac5f37/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,613 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,614 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,614 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712614"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712614"}]},"ts":"1689188712614"} 2023-07-12 19:05:12,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,616 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily11 2023-07-12 19:05:12,616 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily11 2023-07-12 19:05:12,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e07929b49eb60c0014549c0b944194b1 2023-07-12 19:05:12,617 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 857f7f7098ef081088fbf17dc14c7fab columnFamilyName colfamily11 2023-07-12 19:05:12,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,620 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(310): Store=857f7f7098ef081088fbf17dc14c7fab/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,620 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:05:12,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e07929b49eb60c0014549c0b944194b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67100833, jitterRate=-1.1967122554779053E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e07929b49eb60c0014549c0b944194b1: 2023-07-12 19:05:12,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1., pid=48, masterSystemTime=1689188712290 2023-07-12 19:05:12,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=33 2023-07-12 19:05:12,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=33, state=SUCCESS; OpenRegionProcedure 29241abdf5ae1e6c42878fb2f5b4824c, server=jenkins-hbase20.apache.org,35281,1689188708201 in 410 msec 2023-07-12 19:05:12,625 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily21 2023-07-12 19:05:12,625 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily21 2023-07-12 19:05:12,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:05:12,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:05:12,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:05:12,626 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 857f7f7098ef081088fbf17dc14c7fab columnFamilyName colfamily21 2023-07-12 19:05:12,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3932389baa9a41fc2c9f3bd588489325, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-12 19:05:12,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN in 736 msec 2023-07-12 19:05:12,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,628 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=e07929b49eb60c0014549c0b944194b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 67ebaa1418ea2c26ad1d3745ebac5f37; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64774949, jitterRate=-0.03477804362773895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 67ebaa1418ea2c26ad1d3745ebac5f37: 2023-07-12 19:05:12,629 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712628"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712628"}]},"ts":"1689188712628"} 2023-07-12 19:05:12,629 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(310): Store=857f7f7098ef081088fbf17dc14c7fab/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,629 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37., pid=39, masterSystemTime=1689188712215 2023-07-12 19:05:12,631 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,632 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily31 2023-07-12 19:05:12,632 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily31 2023-07-12 19:05:12,633 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 857f7f7098ef081088fbf17dc14c7fab columnFamilyName colfamily31 2023-07-12 19:05:12,634 DEBUG [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily11 2023-07-12 19:05:12,634 DEBUG [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily11 2023-07-12 19:05:12,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:05:12,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:05:12,635 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3932389baa9a41fc2c9f3bd588489325 columnFamilyName colfamily11 2023-07-12 19:05:12,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:05:12,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7f9802929d88c18bd6a77756ccfe2c6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2023-07-12 19:05:12,635 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(310): Store=857f7f7098ef081088fbf17dc14c7fab/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,637 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] regionserver.HStore(310): Store=3932389baa9a41fc2c9f3bd588489325/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,637 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=25 2023-07-12 19:05:12,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=25, state=SUCCESS; OpenRegionProcedure e07929b49eb60c0014549c0b944194b1, server=jenkins-hbase20.apache.org,36833,1689188708236 in 479 msec 2023-07-12 19:05:12,640 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,640 DEBUG [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily21 2023-07-12 19:05:12,640 DEBUG [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily21 2023-07-12 19:05:12,641 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3932389baa9a41fc2c9f3bd588489325 columnFamilyName colfamily21 2023-07-12 19:05:12,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e07929b49eb60c0014549c0b944194b1, ASSIGN in 752 msec 2023-07-12 19:05:12,642 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] regionserver.HStore(310): Store=3932389baa9a41fc2c9f3bd588489325/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,642 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,642 DEBUG [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily11 2023-07-12 19:05:12,642 DEBUG [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily11 2023-07-12 19:05:12,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,643 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,643 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7f9802929d88c18bd6a77756ccfe2c6 columnFamilyName colfamily11 2023-07-12 19:05:12,643 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188712642"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712642"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712642"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712642"}]},"ts":"1689188712642"} 2023-07-12 19:05:12,644 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] regionserver.HStore(310): Store=c7f9802929d88c18bd6a77756ccfe2c6/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,644 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:05:12,645 DEBUG [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily31 2023-07-12 19:05:12,646 DEBUG [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily31 2023-07-12 19:05:12,646 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3932389baa9a41fc2c9f3bd588489325 columnFamilyName colfamily31 2023-07-12 19:05:12,646 DEBUG [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily21 2023-07-12 19:05:12,646 DEBUG [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily21 2023-07-12 19:05:12,647 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7f9802929d88c18bd6a77756ccfe2c6 columnFamilyName colfamily21 2023-07-12 19:05:12,647 INFO [StoreOpener-3932389baa9a41fc2c9f3bd588489325-1] regionserver.HStore(310): Store=3932389baa9a41fc2c9f3bd588489325/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,648 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] regionserver.HStore(310): Store=c7f9802929d88c18bd6a77756ccfe2c6/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,648 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=35 2023-07-12 19:05:12,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=35, state=SUCCESS; OpenRegionProcedure 67ebaa1418ea2c26ad1d3745ebac5f37, server=jenkins-hbase20.apache.org,44977,1689188708156 in 560 msec 2023-07-12 19:05:12,653 DEBUG [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily31 2023-07-12 19:05:12,653 DEBUG [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily31 2023-07-12 19:05:12,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=67ebaa1418ea2c26ad1d3745ebac5f37, ASSIGN in 763 msec 2023-07-12 19:05:12,654 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7f9802929d88c18bd6a77756ccfe2c6 columnFamilyName colfamily31 2023-07-12 19:05:12,658 INFO [StoreOpener-c7f9802929d88c18bd6a77756ccfe2c6-1] regionserver.HStore(310): Store=c7f9802929d88c18bd6a77756ccfe2c6/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 857f7f7098ef081088fbf17dc14c7fab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72435990, jitterRate=0.07938036322593689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 857f7f7098ef081088fbf17dc14c7fab: 2023-07-12 19:05:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab., pid=59, masterSystemTime=1689188712341 2023-07-12 19:05:12,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:05:12,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:05:12,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:05:12,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b33686861752ae5f44ef84731832666f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.', STARTKEY => 'vvv', ENDKEY => 'www'} 2023-07-12 19:05:12,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,664 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:05:12,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712664"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712664"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712664"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712664"}]},"ts":"1689188712664"} 2023-07-12 19:05:12,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:05:12,667 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3932389baa9a41fc2c9f3bd588489325; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68167393, jitterRate=0.015773311257362366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3932389baa9a41fc2c9f3bd588489325: 2023-07-12 19:05:12,669 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily11 2023-07-12 19:05:12,670 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily11 2023-07-12 19:05:12,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c7f9802929d88c18bd6a77756ccfe2c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58950841, jitterRate=-0.12156401574611664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c7f9802929d88c18bd6a77756ccfe2c6: 2023-07-12 19:05:12,671 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b33686861752ae5f44ef84731832666f columnFamilyName colfamily11 2023-07-12 19:05:12,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6., pid=43, masterSystemTime=1689188712215 2023-07-12 19:05:12,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325., pid=50, masterSystemTime=1689188712290 2023-07-12 19:05:12,672 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(310): Store=b33686861752ae5f44ef84731832666f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,672 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=22 2023-07-12 19:05:12,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=22, state=SUCCESS; OpenRegionProcedure 857f7f7098ef081088fbf17dc14c7fab, server=jenkins-hbase20.apache.org,35281,1689188708201 in 437 msec 2023-07-12 19:05:12,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:05:12,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:05:12,675 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily21 2023-07-12 19:05:12,675 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily21 2023-07-12 19:05:12,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:05:12,676 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b33686861752ae5f44ef84731832666f columnFamilyName colfamily21 2023-07-12 19:05:12,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:05:12,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:05:12,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecd2244642d3eaca1773ab751ae2cf01, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2023-07-12 19:05:12,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN in 787 msec 2023-07-12 19:05:12,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,677 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(310): Store=b33686861752ae5f44ef84731832666f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,677 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,678 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=3932389baa9a41fc2c9f3bd588489325, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,678 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712677"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712677"}]},"ts":"1689188712677"} 2023-07-12 19:05:12,679 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,679 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily31 2023-07-12 19:05:12,679 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily31 2023-07-12 19:05:12,680 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b33686861752ae5f44ef84731832666f columnFamilyName colfamily31 2023-07-12 19:05:12,680 DEBUG [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily11 2023-07-12 19:05:12,681 DEBUG [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily11 2023-07-12 19:05:12,681 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecd2244642d3eaca1773ab751ae2cf01 columnFamilyName colfamily11 2023-07-12 19:05:12,681 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(310): Store=b33686861752ae5f44ef84731832666f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,681 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] regionserver.HStore(310): Store=ecd2244642d3eaca1773ab751ae2cf01/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,682 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,684 DEBUG [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily21 2023-07-12 19:05:12,684 DEBUG [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily21 2023-07-12 19:05:12,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=26 2023-07-12 19:05:12,685 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecd2244642d3eaca1773ab751ae2cf01 columnFamilyName colfamily21 2023-07-12 19:05:12,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=26, state=SUCCESS; OpenRegionProcedure 3932389baa9a41fc2c9f3bd588489325, server=jenkins-hbase20.apache.org,36833,1689188708236 in 513 msec 2023-07-12 19:05:12,686 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] regionserver.HStore(310): Store=ecd2244642d3eaca1773ab751ae2cf01/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,686 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3932389baa9a41fc2c9f3bd588489325, ASSIGN in 798 msec 2023-07-12 19:05:12,689 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:12,690 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712689"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712689"}]},"ts":"1689188712689"} 2023-07-12 19:05:12,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b33686861752ae5f44ef84731832666f 2023-07-12 19:05:12,690 DEBUG [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily31 2023-07-12 19:05:12,690 DEBUG [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily31 2023-07-12 19:05:12,691 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecd2244642d3eaca1773ab751ae2cf01 columnFamilyName colfamily31 2023-07-12 19:05:12,692 INFO [StoreOpener-ecd2244642d3eaca1773ab751ae2cf01-1] regionserver.HStore(310): Store=ecd2244642d3eaca1773ab751ae2cf01/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=16 2023-07-12 19:05:12,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=16, state=SUCCESS; OpenRegionProcedure c7f9802929d88c18bd6a77756ccfe2c6, server=jenkins-hbase20.apache.org,44977,1689188708156 in 573 msec 2023-07-12 19:05:12,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:05:12,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c7f9802929d88c18bd6a77756ccfe2c6, ASSIGN in 811 msec 2023-07-12 19:05:12,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b33686861752ae5f44ef84731832666f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66025501, jitterRate=-0.01614336669445038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b33686861752ae5f44ef84731832666f: 2023-07-12 19:05:12,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ecd2244642d3eaca1773ab751ae2cf01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70038981, jitterRate=0.04366214573383331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ecd2244642d3eaca1773ab751ae2cf01: 2023-07-12 19:05:12,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01., pid=52, masterSystemTime=1689188712290 2023-07-12 19:05:12,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f., pid=53, masterSystemTime=1689188712341 2023-07-12 19:05:12,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:05:12,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:05:12,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:05:12,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb958e18b8a10f8d7d64dd6db676c171, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.', STARTKEY => 'yyy', ENDKEY => 'zzz'} 2023-07-12 19:05:12,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,710 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=b33686861752ae5f44ef84731832666f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,710 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712710"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712710"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712710"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712710"}]},"ts":"1689188712710"} 2023-07-12 19:05:12,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:05:12,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:05:12,712 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,715 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily11 2023-07-12 19:05:12,715 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily11 2023-07-12 19:05:12,716 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb958e18b8a10f8d7d64dd6db676c171 columnFamilyName colfamily11 2023-07-12 19:05:12,717 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(310): Store=eb958e18b8a10f8d7d64dd6db676c171/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,717 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=31 2023-07-12 19:05:12,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=31, state=SUCCESS; OpenRegionProcedure b33686861752ae5f44ef84731832666f, server=jenkins-hbase20.apache.org,35281,1689188708201 in 526 msec 2023-07-12 19:05:12,719 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily21 2023-07-12 19:05:12,719 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily21 2023-07-12 19:05:12,720 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb958e18b8a10f8d7d64dd6db676c171 columnFamilyName colfamily21 2023-07-12 19:05:12,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN in 830 msec 2023-07-12 19:05:12,721 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(310): Store=eb958e18b8a10f8d7d64dd6db676c171/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,721 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,721 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:12,721 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712721"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712721"}]},"ts":"1689188712721"} 2023-07-12 19:05:12,723 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily31 2023-07-12 19:05:12,723 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily31 2023-07-12 19:05:12,723 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb958e18b8a10f8d7d64dd6db676c171 columnFamilyName colfamily31 2023-07-12 19:05:12,725 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(310): Store=eb958e18b8a10f8d7d64dd6db676c171/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=21 2023-07-12 19:05:12,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=21, state=SUCCESS; OpenRegionProcedure ecd2244642d3eaca1773ab751ae2cf01, server=jenkins-hbase20.apache.org,36833,1689188708236 in 542 msec 2023-07-12 19:05:12,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecd2244642d3eaca1773ab751ae2cf01, ASSIGN in 841 msec 2023-07-12 19:05:12,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:05:12,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened eb958e18b8a10f8d7d64dd6db676c171; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69861921, jitterRate=0.04102374613285065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for eb958e18b8a10f8d7d64dd6db676c171: 2023-07-12 19:05:12,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171., pid=54, masterSystemTime=1689188712341 2023-07-12 19:05:12,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:05:12,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:05:12,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:12,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0c0cdd1d4e3b41a353e9f46f7be136f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-12 19:05:12,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712737"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712737"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712737"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712737"}]},"ts":"1689188712737"} 2023-07-12 19:05:12,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,740 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,742 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11 2023-07-12 19:05:12,742 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11 2023-07-12 19:05:12,743 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0c0cdd1d4e3b41a353e9f46f7be136f columnFamilyName colfamily11 2023-07-12 19:05:12,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=34 2023-07-12 19:05:12,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=34, state=SUCCESS; OpenRegionProcedure eb958e18b8a10f8d7d64dd6db676c171, server=jenkins-hbase20.apache.org,35281,1689188708201 in 545 msec 2023-07-12 19:05:12,744 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(310): Store=f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,744 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN in 856 msec 2023-07-12 19:05:12,747 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily21 2023-07-12 19:05:12,747 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily21 2023-07-12 19:05:12,747 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0c0cdd1d4e3b41a353e9f46f7be136f columnFamilyName colfamily21 2023-07-12 19:05:12,748 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(310): Store=f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,748 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,749 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily31 2023-07-12 19:05:12,749 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily31 2023-07-12 19:05:12,750 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0c0cdd1d4e3b41a353e9f46f7be136f columnFamilyName colfamily31 2023-07-12 19:05:12,750 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(310): Store=f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:05:12,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f0c0cdd1d4e3b41a353e9f46f7be136f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62666877, jitterRate=-0.06619076430797577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f0c0cdd1d4e3b41a353e9f46f7be136f: 2023-07-12 19:05:12,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f., pid=61, masterSystemTime=1689188712341 2023-07-12 19:05:12,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:12,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:12,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:05:12,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 138faa52574bb0c1cc404fea49db5c75, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-12 19:05:12,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:05:12,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,768 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,768 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188712767"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712767"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712767"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712767"}]},"ts":"1689188712767"} 2023-07-12 19:05:12,768 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,770 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily11 2023-07-12 19:05:12,771 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily11 2023-07-12 19:05:12,771 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 138faa52574bb0c1cc404fea49db5c75 columnFamilyName colfamily11 2023-07-12 19:05:12,772 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(310): Store=138faa52574bb0c1cc404fea49db5c75/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=10 2023-07-12 19:05:12,775 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=10, state=SUCCESS; OpenRegionProcedure f0c0cdd1d4e3b41a353e9f46f7be136f, server=jenkins-hbase20.apache.org,35281,1689188708201 in 521 msec 2023-07-12 19:05:12,778 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily21 2023-07-12 19:05:12,778 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily21 2023-07-12 19:05:12,779 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 138faa52574bb0c1cc404fea49db5c75 columnFamilyName colfamily21 2023-07-12 19:05:12,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN in 889 msec 2023-07-12 19:05:12,780 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(310): Store=138faa52574bb0c1cc404fea49db5c75/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,780 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,782 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily31 2023-07-12 19:05:12,782 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily31 2023-07-12 19:05:12,783 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 138faa52574bb0c1cc404fea49db5c75 columnFamilyName colfamily31 2023-07-12 19:05:12,783 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(310): Store=138faa52574bb0c1cc404fea49db5c75/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:05:12,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:05:12,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:05:12,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 19:05:12,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 138faa52574bb0c1cc404fea49db5c75; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67295270, jitterRate=0.002777665853500366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:05:12,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 138faa52574bb0c1cc404fea49db5c75: 2023-07-12 19:05:12,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75., pid=58, masterSystemTime=1689188712341 2023-07-12 19:05:12,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:05:12,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:05:12,798 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:12,798 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188712798"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188712798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188712798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188712798"}]},"ts":"1689188712798"} 2023-07-12 19:05:12,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=20 2023-07-12 19:05:12,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=20, state=SUCCESS; OpenRegionProcedure 138faa52574bb0c1cc404fea49db5c75, server=jenkins-hbase20.apache.org,35281,1689188708201 in 579 msec 2023-07-12 19:05:12,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=9 2023-07-12 19:05:12,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN in 917 msec 2023-07-12 19:05:12,809 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 19:05:12,809 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689188712809"}]},"ts":"1689188712809"} 2023-07-12 19:05:12,811 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLED in hbase:meta 2023-07-12 19:05:12,814 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 19:05:12,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true in 1.8730 sec 2023-07-12 19:05:13,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 19:05:13,079 INFO [Listener at localhost.localdomain/45243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, procId: 9 completed 2023-07-12 19:05:13,079 DEBUG [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true get assigned. Timeout = 60000ms 2023-07-12 19:05:13,081 INFO [Listener at localhost.localdomain/45243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 19:05:13,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35281] regionserver.StoreScanner(1093): Switch to stream read (scanned=32976 bytes) of info 2023-07-12 19:05:13,100 INFO [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(3484): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned to meta. Checking AM states. 2023-07-12 19:05:13,101 INFO [Listener at localhost.localdomain/45243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 19:05:13,101 INFO [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(3504): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned. 2023-07-12 19:05:13,253 DEBUG [hconnection-0x7fc3471e-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 19:05:13,254 DEBUG [hconnection-0x7fc3471e-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 19:05:13,285 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 19:05:13,288 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 19:05:13,311 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36833] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5624 Client: jenkins//148.251.75.209 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:05:13,312 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44977] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5625 Client: jenkins//148.251.75.209 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:05:13,314 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35281] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//148.251.75.209 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:05:13,508 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 19:05:13,521 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 19:05:13,529 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 19:05:13,536 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 19:05:13,542 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 19:05:13,549 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 19:05:13,556 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 19:05:13,562 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 19:05:13,567 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 19:05:13,573 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 19:05:13,579 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 19:05:13,585 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 19:05:13,591 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 19:05:13,597 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 19:05:13,603 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 19:05:13,609 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 19:05:13,614 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 19:05:13,620 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 19:05:13,625 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 19:05:13,631 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 19:05:13,637 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 19:05:13,642 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 19:05:13,648 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 19:05:13,653 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 19:05:13,659 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 19:05:13,670 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 19:05:13,676 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 19:05:13,682 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 19:05:13,688 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 19:05:13,694 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 19:05:13,700 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 19:05:13,707 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 19:05:13,712 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 19:05:13,718 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 19:05:13,724 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 19:05:13,730 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 19:05:13,736 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 19:05:13,741 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 19:05:13,747 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 19:05:13,752 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 19:05:13,758 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 19:05:13,763 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 19:05:13,768 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 19:05:13,772 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 19:05:13,777 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 19:05:13,783 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 19:05:13,787 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 19:05:13,793 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 19:05:13,796 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 19:05:13,801 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 19:05:14,070 WARN [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: true 2023-07-12 19:05:14,070 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentTestingUtil(82): KILL REGION SERVER jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:14,070 INFO [Listener at localhost.localdomain/45243] hbase.MiniHBaseCluster(271): Killing jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:14,073 ERROR [Listener at localhost.localdomain/45243] helpers.MarkerIgnoringBase(143): ***** ABORTING region server jenkins-hbase20.apache.org,35281,1689188708201: Simulated kill ***** 2023-07-12 19:05:14,074 ERROR [Listener at localhost.localdomain/45243] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-12 19:05:14,077 DEBUG [Listener at localhost.localdomain/45243] util.JSONBean(130): Listing beans for java.lang:type=Memory 2023-07-12 19:05:14,080 DEBUG [Listener at localhost.localdomain/45243] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=IPC 2023-07-12 19:05:14,080 DEBUG [Listener at localhost.localdomain/45243] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Replication 2023-07-12 19:05:14,081 DEBUG [Listener at localhost.localdomain/45243] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Server 2023-07-12 19:05:14,082 INFO [Listener at localhost.localdomain/45243] regionserver.HRegionServer(2557): Dump of metrics as JSON on abort: { "beans": [ { "name": "java.lang:type=Memory", "modelerType": "sun.management.MemoryImpl", "ObjectPendingFinalizationCount": 0, "HeapMemoryUsage": { "committed": 1003487232, "init": 524288000, "max": 2051014656, "used": 405758936 }, "NonHeapMemoryUsage": { "committed": 127623168, "init": 2555904, "max": -1, "used": 125349984 }, "Verbose": false, "ObjectName": "java.lang:type=Memory" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType": "RegionServer,sub=IPC", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase20.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType": "RegionServer,sub=Replication", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase20.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType": "RegionServer,sub=Server", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase20.apache.org" } ] } 2023-07-12 19:05:14,085 WARN [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41319] master.MasterRpcServices(612): jenkins-hbase20.apache.org,35281,1689188708201 reported a fatal error: ***** ABORTING region server jenkins-hbase20.apache.org,35281,1689188708201: Simulated kill ***** 2023-07-12 19:05:14,087 INFO [Listener at localhost.localdomain/45243] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,35281,1689188708201' ***** 2023-07-12 19:05:14,088 INFO [Listener at localhost.localdomain/45243] regionserver.HRegionServer(2311): STOPPED: Simulated kill 2023-07-12 19:05:14,088 INFO [RS:1;jenkins-hbase20:35281] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 19:05:14,088 INFO [RS:1;jenkins-hbase20:35281] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager abruptly. 2023-07-12 19:05:14,088 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 19:05:14,088 INFO [RS:1;jenkins-hbase20:35281] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager abruptly. 2023-07-12 19:05:14,088 INFO [Listener at localhost.localdomain/45243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 19:05:14,089 DEBUG [RS:1;jenkins-hbase20:35281] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53d64674 to 127.0.0.1:62537 2023-07-12 19:05:14,089 DEBUG [RS:1;jenkins-hbase20:35281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:05:14,104 DEBUG [RS:1;jenkins-hbase20:35281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:05:14,105 INFO [RS:1;jenkins-hbase20:35281] regionserver.LeaseManager(133): Closed leases 2023-07-12 19:05:14,105 INFO [RS:1;jenkins-hbase20:35281] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35281 2023-07-12 19:05:14,114 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:14,115 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:05:14,115 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:14,115 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 2023-07-12 19:05:14,115 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:05:14,115 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:05:14,115 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:05:14,117 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35281,1689188708201] 2023-07-12 19:05:14,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:14,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:14,117 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35281,1689188708201; numProcessing=1 2023-07-12 19:05:14,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:14,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:14,118 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 znode expired, triggering replicatorRemoved event 2023-07-12 19:05:14,118 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase20.apache.org,35281,1689188708201 znode expired, triggering replicatorRemoved event 2023-07-12 19:05:14,119 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35281,1689188708201 already deleted, retry=false 2023-07-12 19:05:14,119 INFO [RegionServerTracker-0] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,35281,1689188708201 on jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:05:14,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:14,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:05:14,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:14,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:05:14,126 DEBUG [RegionServerTracker-0] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:05:14,126 INFO [RegionServerTracker-0] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=62 for jenkins-hbase20.apache.org,35281,1689188708201 (carryingMeta=true) jenkins-hbase20.apache.org,35281,1689188708201/CRASHED/regionCount=11/lock=java.util.concurrent.locks.ReentrantReadWriteLock@31eb8260[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 19:05:14,129 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:05:14,129 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:05:14,129 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:05:14,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:05:14,129 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:05:14,167 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 19:05:14,190 INFO [Listener at localhost.localdomain/45243] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 19:05:14,193 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 0 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:05:14,193 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:05:14,194 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:05:14,194 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:05:14,196 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-12 19:05:14,197 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:05:14,197 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:05:14,197 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:05:14,197 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:05:14,198 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 19:05:14,202 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[] 2023-07-12 19:05:14,204 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:05:14,204 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:05:14,205 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:05:14,205 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:05:14,206 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:05:14,207 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:05:14,207 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:05:14,208 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 9 msec 2023-07-12 19:05:14,208 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:05:14,209 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,35281,1689188708201, table=hbase:meta, region=1588230740 2023-07-12 19:05:14,210 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188744210 2023-07-12 19:05:14,212 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:05:14,212 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:05:14,212 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:05:14,214 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:14,214 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:05:14,215 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true, isMeta: true 2023-07-12 19:05:14,218 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting 2023-07-12 19:05:14,220 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=1, meta=true 2023-07-12 19:05:14,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta}] 2023-07-12 19:05:14,223 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:05:14,223 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:05:14,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:05:14,224 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:05:14,291 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:05:14,292 INFO [RS:1;jenkins-hbase20:35281] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,35281,1689188708201; zookeeper connection closed. 2023-07-12 19:05:14,292 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:35281-0x1008292a4e80002, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:05:14,292 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@356eb035] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@356eb035 2023-07-12 19:05:14,320 DEBUG [hconnection-0x45ea540d-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:05:14,489 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 19:05:14,489 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 19:05:14,522 DEBUG [hconnection-0x45ea540d-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:05:14,826 DEBUG [hconnection-0x45ea540d-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:05:15,330 DEBUG [hconnection-0x45ea540d-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:05:15,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 19:05:15,459 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 19:05:15,459 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 19:05:15,460 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true' 2023-07-12 19:05:16,339 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:16,340 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:05:17,318 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 19:05:17,319 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 19:05:18,345 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:18,346 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:05:18,347 DEBUG [hconnection-0x45ea540d-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4134 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:22,357 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:22,358 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:05:22,358 DEBUG [hconnection-0x45ea540d-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8146 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:32,416 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:32,418 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:05:32,419 DEBUG [hconnection-0x45ea540d-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18206 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:42,431 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:42,433 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:05:42,433 DEBUG [hconnection-0x45ea540d-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28221 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:52,465 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:52,467 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:05:52,467 DEBUG [hconnection-0x45ea540d-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38255 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:05:55,850 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase20.apache.org,35281,1689188708201 already deleted, retry=false 2023-07-12 19:06:02,494 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:02,497 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:02,497 DEBUG [hconnection-0x45ea540d-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48285 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:02,499 DEBUG [Listener at localhost.localdomain/45243] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68350: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68350: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:02,501 WARN [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T19:06:02.501Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68350: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68350: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:02,503 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 1 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:06:02,503 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:06:02,504 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:06:02,504 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:06:02,504 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:06:02,505 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:06:02,505 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:06:02,505 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:06:02,505 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:06:02,509 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 3 msec 2023-07-12 19:06:02,511 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0] 2023-07-12 19:06:02,511 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:06:02,512 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:06:02,512 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:06:02,512 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:06:02,513 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:06:02,514 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:06:02,514 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:06:02,514 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-07-12 19:06:02,515 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:06:02,515 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,35281,1689188708201, table=hbase:meta, region=1588230740 2023-07-12 19:06:02,517 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188792517 2023-07-12 19:06:02,518 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:06:02,518 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true, isMeta: true 2023-07-12 19:06:02,521 DEBUG [hconnection-0x45ea540d-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:02,523 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=1, meta=true 2023-07-12 19:06:02,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta}] 2023-07-12 19:06:02,523 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:06:02,532 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:06:02,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:06:02,625 DEBUG [hconnection-0x45ea540d-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:02,704 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44977] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=64 2023-07-12 19:06:02,725 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(300): Splitting hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, size=55.0 K (56310bytes) 2023-07-12 19:06:02,725 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta 2023-07-12 19:06:02,729 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta after 4ms 2023-07-12 19:06:02,737 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(311): Open hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta took 13ms 2023-07-12 19:06:02,753 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(346): Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:06:02,762 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0-Writer-2] util.CommonFSUtils$DfsBuilderUtility(753): Could not find replicate method on builder; will not set replicate when creating output stream java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DistributedFileSystem$HdfsDataOutputStreamBuilder.replicate() at java.lang.Class.getMethod(Class.java:1786) at org.apache.hadoop.hbase.util.CommonFSUtils$DfsBuilderUtility.(CommonFSUtils.java:750) at org.apache.hadoop.hbase.util.CommonFSUtils.createForWal(CommonFSUtils.java:802) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.initOutput(ProtobufLogWriter.java:102) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:78) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.createRecoveredEditsWriter(WALFactory.java:402) at org.apache.hadoop.hbase.wal.WALSplitter.createWriter(WALSplitter.java:516) at org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink.createRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.java:69) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.getRecoveredEditsWriter(RecoveredEditsOutputSink.java:81) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.append(RecoveredEditsOutputSink.java:63) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.writeBuffer(OutputSink.java:249) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.doRun(OutputSink.java:241) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.run(OutputSink.java:211) 2023-07-12 19:06:02,764 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta so closing down 2023-07-12 19:06:02,764 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-12 19:06:02,766 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta.temp 2023-07-12 19:06:02,770 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-12 19:06:02,789 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) 2023-07-12 19:06:02,791 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 19:06:02,791 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(423): Processed 61 edits across 1 Regions in 53 ms; skipped=1; WAL=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, size=55.0 K, length=56310, corrupted=false, cancelled=false 2023-07-12 19:06:02,791 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, journal: Splitting hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, size=55.0 K (56310bytes) at 1689188762725Finishing writing output for hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta so closing down at 1689188762764 (+39 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta.temp at 1689188762766 (+2 ms)3 split writer threads finished at 1689188762770 (+4 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) at 1689188762789 (+19 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 at 1689188762791 (+2 ms)Processed 61 edits across 1 Regions in 53 ms; skipped=1; WAL=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, size=55.0 K, length=56310, corrupted=false, cancelled=false at 1689188762791 2023-07-12 19:06:02,792 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta 2023-07-12 19:06:02,794 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=64 2023-07-12 19:06:02,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.HMaster(3641): Remote procedure done, pid=64 2023-07-12 19:06:02,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] wal.WALSplitUtil(141): Moved hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs 2023-07-12 19:06:02,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-12 19:06:02,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 in 271 msec 2023-07-12 19:06:02,808 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:06:02,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=62 2023-07-12 19:06:02,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 in 286 msec 2023-07-12 19:06:02,814 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting dir is empty, no logs to split. 2023-07-12 19:06:02,814 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=0, meta=true 2023-07-12 19:06:02,814 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,35281,1689188708201 WAL splitting is done? wals=0, meta=true 2023-07-12 19:06:02,814 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:06:02,814 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:06:02,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:06:02,815 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:06:02,829 DEBUG [hconnection-0x45ea540d-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:03,133 DEBUG [hconnection-0x45ea540d-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:03,640 DEBUG [hconnection-0x45ea540d-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:04,654 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:04,656 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:05,445 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase20.apache.org,35281,1689188708201 already deleted, retry=false 2023-07-12 19:06:06,674 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:06,679 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:06,679 DEBUG [hconnection-0x45ea540d-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4158 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:10,694 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:10,695 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:10,696 DEBUG [hconnection-0x45ea540d-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8174 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:20,745 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:20,748 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:20,748 DEBUG [hconnection-0x45ea540d-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18227 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:30,800 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:30,802 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:30,802 DEBUG [hconnection-0x45ea540d-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28281 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:40,867 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:40,868 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:40,869 DEBUG [hconnection-0x45ea540d-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38347 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:50,912 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:50,913 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:50,913 DEBUG [hconnection-0x45ea540d-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48392 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:50,914 DEBUG [Listener at localhost.localdomain/45243] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68480: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68480: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:50,915 WARN [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T19:06:50.915Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68480: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68480: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:50,916 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 2 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:06:50,916 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:06:50,916 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:06:50,916 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:06:50,916 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:06:50,916 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:06:50,917 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:06:50,917 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:06:50,917 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:06:50,920 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 3 msec 2023-07-12 19:06:50,922 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1] 2023-07-12 19:06:50,922 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 19:06:50,922 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 19:06:50,923 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:06:50,923 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:06:50,923 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:06:50,923 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:06:50,924 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:06:50,925 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:06:50,925 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:06:50,925 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:06:50,925 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:06:50,925 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:06:50,925 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:06:50,926 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-12 19:06:50,926 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:06:50,927 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,35281,1689188708201, table=hbase:meta, region=1588230740 2023-07-12 19:06:50,927 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188840927 2023-07-12 19:06:50,928 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:06:50,932 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting dir is empty, no logs to split. 2023-07-12 19:06:50,932 DEBUG [hconnection-0x45ea540d-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:50,932 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=0, meta=true 2023-07-12 19:06:50,932 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,35281,1689188708201 WAL splitting is done? wals=0, meta=true 2023-07-12 19:06:50,932 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:06:50,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 19:06:50,934 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:06:50,934 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:06:50,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:06:50,934 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:06:51,034 DEBUG [hconnection-0x45ea540d-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:51,237 DEBUG [hconnection-0x45ea540d-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:51,540 DEBUG [hconnection-0x45ea540d-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:52,045 DEBUG [hconnection-0x45ea540d-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:06:53,048 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:53,049 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:55,069 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:55,070 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:55,070 DEBUG [hconnection-0x45ea540d-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4138 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:59,105 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:06:59,106 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:06:59,106 DEBUG [hconnection-0x45ea540d-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8174 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:09,124 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:09,126 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:07:09,126 DEBUG [hconnection-0x45ea540d-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18194 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:09,576 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-12 19:07:19,159 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:19,163 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:07:19,164 DEBUG [hconnection-0x45ea540d-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28231 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:29,183 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:29,185 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:07:29,186 DEBUG [hconnection-0x45ea540d-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38253 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:39,195 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:39,196 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:07:39,197 DEBUG [hconnection-0x45ea540d-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48264 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:39,198 DEBUG [Listener at localhost.localdomain/45243] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68403: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68403: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:39,200 WARN [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T19:07:39.199Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68403: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68403: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,35281,1689188708201, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:35281 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:39,200 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 3 exec state=pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:39,201 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:07:39,201 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:07:39,201 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:07:39,201 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:07:39,202 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:07:39,202 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:07:39,202 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:07:39,202 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:07:39,204 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 19:07:39,206 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7] 2023-07-12 19:07:39,207 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 19:07:39,207 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 19:07:39,207 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:07:39,207 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:07:39,207 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:07:39,208 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:07:39,209 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:07:39,209 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:39,209 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:39,209 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:39,209 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:07:39,209 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:39,209 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:39,210 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-12 19:07:39,210 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:07:39,211 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,35281,1689188708201, table=hbase:meta, region=1588230740 2023-07-12 19:07:39,211 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188889211 2023-07-12 19:07:39,212 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:07:39,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 19:07:39,212 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:07:39,214 DEBUG [hconnection-0x45ea540d-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:39,214 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 19:07:39,215 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:39,316 DEBUG [hconnection-0x45ea540d-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:39,365 DEBUG [jenkins-hbase20:41319] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-12 19:07:39,366 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 19:07:39,366 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 19:07:39,366 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 19:07:39,366 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 19:07:39,367 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36833,1689188708236, state=OPENING 2023-07-12 19:07:39,368 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 19:07:39,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:07:39,368 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 19:07:39,522 WARN [ReadOnlyZKClient-127.0.0.1:62537@0x3ca57b17] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-12 19:07:39,523 DEBUG [hconnection-0x45ea540d-shared-pool-8] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 19:07:39,528 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 19:07:39,528 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 19:07:39,529 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36833] ipc.CallRunner(144): callId: 143 service: ClientService methodName: Scan size: 97 connection: 148.251.75.209:60638 deadline: 1689188919220, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:39,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 19:07:39,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 19:07:39,542 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36833%2C1689188708236.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,36833,1689188708236, archiveDir=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs, maxLogs=32 2023-07-12 19:07:39,559 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK] 2023-07-12 19:07:39,560 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK] 2023-07-12 19:07:39,561 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK] 2023-07-12 19:07:39,566 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,36833,1689188708236/jenkins-hbase20.apache.org%2C36833%2C1689188708236.meta.1689188859544.meta 2023-07-12 19:07:39,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34459,DS-b9a7a141-4f58-4b41-8665-186cc2d66fe4,DISK], DatanodeInfoWithStorage[127.0.0.1:40545,DS-6e38f439-14e8-4bfc-9dd4-56158fef3c25,DISK], DatanodeInfoWithStorage[127.0.0.1:45871,DS-4431d02f-6c86-4dd1-8aee-79bcfdf18cab,DISK]] 2023-07-12 19:07:39,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 19:07:39,567 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 19:07:39,567 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 19:07:39,567 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 19:07:39,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 19:07:39,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:39,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 19:07:39,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 19:07:39,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 19:07:39,570 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info 2023-07-12 19:07:39,570 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info 2023-07-12 19:07:39,571 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 19:07:39,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:39,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 19:07:39,573 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/rep_barrier 2023-07-12 19:07:39,573 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/rep_barrier 2023-07-12 19:07:39,573 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 19:07:39,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:39,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 19:07:39,576 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/table 2023-07-12 19:07:39,576 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/table 2023-07-12 19:07:39,576 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 19:07:39,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:39,577 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740 2023-07-12 19:07:39,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740 2023-07-12 19:07:39,580 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 19:07:39,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 274, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=63, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 19:07:39,597 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=51.48 KB heapSize=72.27 KB 2023-07-12 19:07:39,660 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=51.19 KB at sequenceid=63 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/.tmp/info/18cb5ae981df4c1fb2631557878d1a83 2023-07-12 19:07:39,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=296 B at sequenceid=63 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/.tmp/table/67d90a5b15f7469d9253cdea4d041e95 2023-07-12 19:07:39,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/.tmp/info/18cb5ae981df4c1fb2631557878d1a83 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info/18cb5ae981df4c1fb2631557878d1a83 2023-07-12 19:07:39,731 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info/18cb5ae981df4c1fb2631557878d1a83, entries=270, sequenceid=63, filesize=57.3 K 2023-07-12 19:07:39,733 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/.tmp/table/67d90a5b15f7469d9253cdea4d041e95 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/table/67d90a5b15f7469d9253cdea4d041e95 2023-07-12 19:07:39,740 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/table/67d90a5b15f7469d9253cdea4d041e95, entries=4, sequenceid=63, filesize=4.9 K 2023-07-12 19:07:39,740 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~51.48 KB/52718, heapSize ~71.99 KB/73720, currentSize=0 B/0 for 1588230740 in 144ms, sequenceid=63, compaction requested=false; wal=null 2023-07-12 19:07:39,743 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 19:07:39,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:39,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 19:07:39,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=1 2023-07-12 19:07:39,753 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=64; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71506244, jitterRate=0.0655260682106018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:39,753 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 19:07:39,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=66, masterSystemTime=1689188859521 2023-07-12 19:07:39,756 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 19:07:39,756 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 19:07:39,756 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36833,1689188708236, state=OPEN 2023-07-12 19:07:39,757 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 19:07:39,757 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 19:07:39,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-12 19:07:39,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 in 389 msec 2023-07-12 19:07:39,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=62 2023-07-12 19:07:39,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-07-12 19:07:39,882 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,882 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,883 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=d553d6a56ac1a02eae16d402efdad87b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,883 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,883 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,883 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,884 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eea56a3c84bac34483f036ea38341f7c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,884 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,884 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,884 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,885 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,885 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,885 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,885 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,886 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,886 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,886 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e07929b49eb60c0014549c0b944194b1, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,886 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=3932389baa9a41fc2c9f3bd588489325, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,887 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,887 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,887 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,887 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=1d3260808db8616b1e8580567e7ef724, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,888 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b33686861752ae5f44ef84731832666f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,888 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:39,888 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,888 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:39,888 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:39,889 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 19:07:39,889 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689188919889 2023-07-12 19:07:39,889 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689188979889 2023-07-12 19:07:39,889 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1536): Joined the cluster in 677 msec 2023-07-12 19:07:39,890 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,35281,1689188708201 had 11 regions 2023-07-12 19:07:39,890 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:07:39,890 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:39,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:07:39,890 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:07:40,139 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 4 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,139 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:07:40,139 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:07:40,140 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:07:40,140 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:07:40,140 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:07:40,140 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:07:40,140 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:07:40,140 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:07:40,141 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 19:07:40,143 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14] 2023-07-12 19:07:40,143 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 19:07:40,143 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 19:07:40,143 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 19:07:40,143 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 19:07:40,144 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:07:40,144 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:07:40,144 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:07:40,145 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:07:40,146 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:07:40,147 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,147 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,147 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,147 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 19:07:40,148 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:40,148 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:07:40,148 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,148 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,148 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,148 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,148 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-12 19:07:40,149 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:07:40,150 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,36833,1689188708236, table=hbase:meta, region=1588230740 2023-07-12 19:07:40,151 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188890151 2023-07-12 19:07:40,153 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:07:40,159 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,160 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,160 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=d553d6a56ac1a02eae16d402efdad87b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,160 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,160 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,160 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,161 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eea56a3c84bac34483f036ea38341f7c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,161 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,161 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,161 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,161 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,162 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,162 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,162 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,162 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,162 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,162 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e07929b49eb60c0014549c0b944194b1, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=3932389baa9a41fc2c9f3bd588489325, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=1d3260808db8616b1e8580567e7ef724, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b33686861752ae5f44ef84731832666f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,163 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,164 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,164 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,164 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 19:07:40,164 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689188920164 2023-07-12 19:07:40,164 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689188980164 2023-07-12 19:07:40,164 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1536): Joined the cluster in 11 msec 2023-07-12 19:07:40,164 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,35281,1689188708201 had 10 regions 2023-07-12 19:07:40,164 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:07:40,166 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true, isMeta: false 2023-07-12 19:07:40,168 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=1, meta=false 2023-07-12 19:07:40,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626}] 2023-07-12 19:07:40,169 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:07:40,169 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:07:40,169 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:07:40,414 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 5 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,415 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:07:40,415 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:07:40,415 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:07:40,416 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:07:40,416 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:07:40,416 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:07:40,416 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:07:40,416 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:07:40,418 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 19:07:40,420 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16] 2023-07-12 19:07:40,420 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 19:07:40,420 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 19:07:40,420 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 19:07:40,420 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 19:07:40,420 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:07:40,421 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:07:40,421 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:07:40,421 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:07:40,422 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:07:40,423 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,423 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,423 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,424 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 19:07:40,424 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:40,424 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:07:40,424 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,424 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,424 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,424 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,424 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-12 19:07:40,425 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:07:40,426 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,36833,1689188708236, table=hbase:meta, region=1588230740 2023-07-12 19:07:40,426 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188890426 2023-07-12 19:07:40,427 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:07:40,434 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,434 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,434 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=d553d6a56ac1a02eae16d402efdad87b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,434 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,435 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,435 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,435 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eea56a3c84bac34483f036ea38341f7c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,435 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,435 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,435 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,435 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,436 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,436 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,436 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,436 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,436 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,436 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e07929b49eb60c0014549c0b944194b1, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,436 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=3932389baa9a41fc2c9f3bd588489325, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=1d3260808db8616b1e8580567e7ef724, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b33686861752ae5f44ef84731832666f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,437 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,438 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,438 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 19:07:40,438 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689188920438 2023-07-12 19:07:40,438 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689188980438 2023-07-12 19:07:40,438 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1536): Joined the cluster in 10 msec 2023-07-12 19:07:40,438 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true, isMeta: false 2023-07-12 19:07:40,440 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=1, meta=false 2023-07-12 19:07:40,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626}] 2023-07-12 19:07:40,440 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:07:40,442 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:07:40,596 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44977] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=68 2023-07-12 19:07:40,607 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(300): Splitting hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, size=327.7 K (335557bytes) 2023-07-12 19:07:40,607 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 2023-07-12 19:07:40,608 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 after 1ms 2023-07-12 19:07:40,613 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(311): Open hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 took 6ms 2023-07-12 19:07:40,616 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 673c9299883e0a0c447ecfa6b4e5e829: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,618 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for e088ea3e439d4723be549ccd39a34867: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,619 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 9ada7efcd7f8e906f8ea0900275391d5: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,621 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for ce7575edbb1d7e25bd4ed4b3e5bec644: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,622 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 29241abdf5ae1e6c42878fb2f5b4824c: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,623 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 857f7f7098ef081088fbf17dc14c7fab: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,623 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,624 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for b33686861752ae5f44ef84731832666f: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,625 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for eb958e18b8a10f8d7d64dd6db676c171: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,626 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for f0c0cdd1d4e3b41a353e9f46f7be136f: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,627 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 138faa52574bb0c1cc404fea49db5c75: last_flushed_sequence_id: 18446744073709551615 2023-07-12 19:07:40,633 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,637 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,647 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,648 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(400): Finishing writing output for hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 so closing down 2023-07-12 19:07:40,648 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-12 19:07:40,649 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,650 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,652 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,654 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,655 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,658 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp 2023-07-12 19:07:40,659 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.OutputSink(146): 3 split writer threads finished 2023-07-12 19:07:40,715 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,721 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,725 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,726 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004 2023-07-12 19:07:40,728 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004 2023-07-12 19:07:40,730 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004 2023-07-12 19:07:40,754 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,754 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-12 19:07:40,756 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004 2023-07-12 19:07:40,757 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004 2023-07-12 19:07:40,760 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-12 19:07:40,761 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004 2023-07-12 19:07:40,781 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,782 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 2 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,783 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004 2023-07-12 19:07:40,783 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000005 2023-07-12 19:07:40,785 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,786 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004 2023-07-12 19:07:40,793 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 19:07:40,794 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004 2023-07-12 19:07:40,794 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(423): Processed 21 edits across 10 Regions in 181 ms; skipped=10; WAL=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, size=327.7 K, length=335557, corrupted=false, cancelled=false 2023-07-12 19:07:40,795 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(426): Completed split of hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, journal: Splitting hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, size=327.7 K (335557bytes) at 1689188860607Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860624 (+17 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860633 (+9 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860638 (+5 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860647 (+9 ms)Split 11 edits, skipped 10 edits. at 1689188860648 (+1 ms)Finishing writing output for hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 so closing down at 1689188860648Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860649 (+1 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860651 (+2 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860652 (+1 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860655 (+3 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860655Creating recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp at 1689188860659 (+4 ms)3 split writer threads finished at 1689188860659Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689188860715 (+56 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689188860721 (+6 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689188860725 (+4 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004 at 1689188860726 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004 at 1689188860728 (+2 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004 at 1689188860731 (+3 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689188860754 (+23 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689188860754Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004 at 1689188860756 (+2 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004 at 1689188860758 (+2 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689188860760 (+2 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004 at 1689188860761 (+1 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689188860782 (+21 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 2 edits, skipped 0 edits in 0 ms) at 1689188860782Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004 at 1689188860783 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000005 at 1689188860784 (+1 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689188860785 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004 at 1689188860787 (+2 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689188860793 (+6 ms)Rename recovered edits hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626.temp to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004 at 1689188860794 (+1 ms)Processed 21 edits across 10 Regions in 181 ms; skipped=10; WAL=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, size=327.7 K, length=335557, corrupted=false, cancelled=false at 1689188860794 2023-07-12 19:07:40,795 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 2023-07-12 19:07:40,795 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=68 2023-07-12 19:07:40,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] master.HMaster(3641): Remote procedure done, pid=68 2023-07-12 19:07:40,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41319] wal.WALSplitUtil(141): Moved hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting/jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626 to hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs 2023-07-12 19:07:40,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-12 19:07:40,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 in 356 msec 2023-07-12 19:07:40,802 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=62 2023-07-12 19:07:40,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 in 362 msec 2023-07-12 19:07:40,805 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting dir is empty, no logs to split. 2023-07-12 19:07:40,806 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=0, meta=false 2023-07-12 19:07:40,806 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,35281,1689188708201 WAL splitting is done? wals=0, meta=false 2023-07-12 19:07:40,806 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:07:40,806 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:07:40,807 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:07:40,938 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 6 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,938 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:07:40,939 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:07:40,939 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:07:40,939 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:07:40,940 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:07:40,940 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:07:40,940 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:07:40,940 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:07:40,942 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 19:07:40,945 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18] 2023-07-12 19:07:40,946 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 19:07:40,946 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 19:07:40,946 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 19:07:40,946 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 19:07:40,947 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 19:07:40,947 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 19:07:40,947 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:07:40,947 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:07:40,948 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:07:40,948 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:07:40,949 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:07:40,949 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,950 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,951 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,951 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,951 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:40,951 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 8 msec 2023-07-12 19:07:40,952 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:07:40,952 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,36833,1689188708236, table=hbase:meta, region=1588230740 2023-07-12 19:07:40,952 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188890952 2023-07-12 19:07:40,953 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:07:40,960 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,960 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,960 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=d553d6a56ac1a02eae16d402efdad87b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,960 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,961 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,961 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,961 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eea56a3c84bac34483f036ea38341f7c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,961 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,962 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,962 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,962 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,962 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,963 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,963 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,963 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,963 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,963 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e07929b49eb60c0014549c0b944194b1, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,964 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=3932389baa9a41fc2c9f3bd588489325, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,964 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,964 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,964 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,964 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=1d3260808db8616b1e8580567e7ef724, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,965 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b33686861752ae5f44ef84731832666f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,965 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:40,965 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,965 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:40,965 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:40,966 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 19:07:40,966 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689188920966 2023-07-12 19:07:40,966 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689188980966 2023-07-12 19:07:40,966 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1536): Joined the cluster in 12 msec 2023-07-12 19:07:40,967 INFO [PEWorker-1] master.MasterWalManager(320): Log dir for server jenkins-hbase20.apache.org,35281,1689188708201 does not exist 2023-07-12 19:07:40,967 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,35281,1689188708201 WAL count=0, meta=false 2023-07-12 19:07:40,967 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,35281,1689188708201 WAL splitting is done? wals=0, meta=false 2023-07-12 19:07:40,968 INFO [PEWorker-1] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase20.apache.org,35281,1689188708201 failed, ignore...File hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/WALs/jenkins-hbase20.apache.org,35281,1689188708201-splitting does not exist. 2023-07-12 19:07:40,968 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:07:40,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN}, {pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN}] 2023-07-12 19:07:40,970 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:07:40,970 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:40,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:07:40,970 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:07:41,216 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 7 exec state=pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:41,216 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:07:41,216 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:07:41,216 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:07:41,217 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:07:41,217 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:07:41,217 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:07:41,217 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:07:41,217 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:07:41,218 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 19:07:41,219 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25] 2023-07-12 19:07:41,219 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 19:07:41,219 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 19:07:41,219 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 19:07:41,219 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 19:07:41,219 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 19:07:41,219 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 19:07:41,220 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:07:41,220 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:07:41,220 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:07:41,221 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:07:41,221 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:07:41,222 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:41,223 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:41,224 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:41,224 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:41,224 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:41,224 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-12 19:07:41,225 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:07:41,225 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,36833,1689188708236, table=hbase:meta, region=1588230740 2023-07-12 19:07:41,227 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188891227 2023-07-12 19:07:41,228 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:07:41,233 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,233 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,234 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=d553d6a56ac1a02eae16d402efdad87b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,234 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,234 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,234 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,234 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eea56a3c84bac34483f036ea38341f7c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,235 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,235 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,235 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,235 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,235 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,236 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,236 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,236 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,236 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,237 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e07929b49eb60c0014549c0b944194b1, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,237 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=3932389baa9a41fc2c9f3bd588489325, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,237 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,237 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,237 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,238 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=1d3260808db8616b1e8580567e7ef724, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,238 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b33686861752ae5f44ef84731832666f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,238 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:41,238 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,239 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,35281,1689188708201, regionLocation=jenkins-hbase20.apache.org,35281,1689188708201, openSeqNum=2 2023-07-12 19:07:41,239 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:41,239 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 19:07:41,239 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689188921239 2023-07-12 19:07:41,239 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689188981239 2023-07-12 19:07:41,239 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1536): Joined the cluster in 11 msec 2023-07-12 19:07:41,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN}, {pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN}] 2023-07-12 19:07:41,241 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:07:41,243 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN 2023-07-12 19:07:41,244 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,244 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN 2023-07-12 19:07:41,245 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,245 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN 2023-07-12 19:07:41,246 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,247 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN 2023-07-12 19:07:41,247 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,248 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN 2023-07-12 19:07:41,249 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,249 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN 2023-07-12 19:07:41,250 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,251 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN 2023-07-12 19:07:41,252 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,252 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN 2023-07-12 19:07:41,253 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,254 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN 2023-07-12 19:07:41,254 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,255 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN 2023-07-12 19:07:41,256 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 19:07:41,394 DEBUG [jenkins-hbase20:41319] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-12 19:07:41,394 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 19:07:41,394 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 19:07:41,395 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 19:07:41,395 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 19:07:41,396 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 19:07:41,396 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,396 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689188861396"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861396"}]},"ts":"1689188861396"} 2023-07-12 19:07:41,396 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 19:07:41,396 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 19:07:41,397 DEBUG [jenkins-hbase20:41319] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 19:07:41,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=79, ppid=76, state=RUNNABLE; OpenRegionProcedure 673c9299883e0a0c447ecfa6b4e5e829, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:07:41,414 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=78 updating hbase:meta row=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,415 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861414"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861414"}]},"ts":"1689188861414"} 2023-07-12 19:07:41,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=78, state=RUNNABLE; OpenRegionProcedure eb958e18b8a10f8d7d64dd6db676c171, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:07:41,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=b33686861752ae5f44ef84731832666f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861421"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861421"}]},"ts":"1689188861421"} 2023-07-12 19:07:41,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=77, state=RUNNABLE; OpenRegionProcedure b33686861752ae5f44ef84731832666f, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:07:41,425 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=857f7f7098ef081088fbf17dc14c7fab, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,425 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861425"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861425"}]},"ts":"1689188861425"} 2023-07-12 19:07:41,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=75, state=RUNNABLE; OpenRegionProcedure 857f7f7098ef081088fbf17dc14c7fab, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:07:41,429 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=e088ea3e439d4723be549ccd39a34867, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,429 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861429"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861429"}]},"ts":"1689188861429"} 2023-07-12 19:07:41,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=69, state=RUNNABLE; OpenRegionProcedure e088ea3e439d4723be549ccd39a34867, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:07:41,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188861432"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861432"}]},"ts":"1689188861432"} 2023-07-12 19:07:41,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=71, state=RUNNABLE; OpenRegionProcedure f0c0cdd1d4e3b41a353e9f46f7be136f, server=jenkins-hbase20.apache.org,44977,1689188708156}] 2023-07-12 19:07:41,436 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,436 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861436"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861436"}]},"ts":"1689188861436"} 2023-07-12 19:07:41,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=70, state=RUNNABLE; OpenRegionProcedure 29241abdf5ae1e6c42878fb2f5b4824c, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:07:41,439 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,439 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861439"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861439"}]},"ts":"1689188861439"} 2023-07-12 19:07:41,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=86, ppid=74, state=RUNNABLE; OpenRegionProcedure 9ada7efcd7f8e906f8ea0900275391d5, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:07:41,442 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=138faa52574bb0c1cc404fea49db5c75, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,443 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861442"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861442"}]},"ts":"1689188861442"} 2023-07-12 19:07:41,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=73, state=RUNNABLE; OpenRegionProcedure 138faa52574bb0c1cc404fea49db5c75, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:07:41,446 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,446 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861446"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689188861446"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689188861446"}]},"ts":"1689188861446"} 2023-07-12 19:07:41,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=72, state=RUNNABLE; OpenRegionProcedure ce7575edbb1d7e25bd4ed4b3e5bec644, server=jenkins-hbase20.apache.org,36833,1689188708236}] 2023-07-12 19:07:41,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:41,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce7575edbb1d7e25bd4ed4b3e5bec644, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-12 19:07:41,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:41,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e088ea3e439d4723be549ccd39a34867, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-12 19:07:41,578 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,578 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:41,578 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 673c9299883e0a0c447ecfa6b4e5e829, NAME => 'hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.', STARTKEY => '', ENDKEY => ''} 2023-07-12 19:07:41,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:41,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:41,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:41,579 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11 2023-07-12 19:07:41,579 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11 2023-07-12 19:07:41,579 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce7575edbb1d7e25bd4ed4b3e5bec644 columnFamilyName colfamily11 2023-07-12 19:07:41,580 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,580 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(310): Store=ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,580 INFO [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:41,580 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,580 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily11 2023-07-12 19:07:41,581 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily11 2023-07-12 19:07:41,581 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e088ea3e439d4723be549ccd39a34867 columnFamilyName colfamily11 2023-07-12 19:07:41,581 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily21 2023-07-12 19:07:41,581 DEBUG [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/info 2023-07-12 19:07:41,581 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily21 2023-07-12 19:07:41,581 DEBUG [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/info 2023-07-12 19:07:41,581 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(310): Store=e088ea3e439d4723be549ccd39a34867/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,581 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce7575edbb1d7e25bd4ed4b3e5bec644 columnFamilyName colfamily21 2023-07-12 19:07:41,581 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,581 INFO [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 673c9299883e0a0c447ecfa6b4e5e829 columnFamilyName info 2023-07-12 19:07:41,582 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(310): Store=ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,582 INFO [StoreOpener-673c9299883e0a0c447ecfa6b4e5e829-1] regionserver.HStore(310): Store=673c9299883e0a0c447ecfa6b4e5e829/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,582 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,582 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily21 2023-07-12 19:07:41,582 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily21 2023-07-12 19:07:41,583 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e088ea3e439d4723be549ccd39a34867 columnFamilyName colfamily21 2023-07-12 19:07:41,583 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(310): Store=e088ea3e439d4723be549ccd39a34867/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,583 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,584 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily31 2023-07-12 19:07:41,584 DEBUG [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily31 2023-07-12 19:07:41,584 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e088ea3e439d4723be549ccd39a34867 columnFamilyName colfamily31 2023-07-12 19:07:41,585 INFO [StoreOpener-e088ea3e439d4723be549ccd39a34867-1] regionserver.HStore(310): Store=e088ea3e439d4723be549ccd39a34867/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,586 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily31 2023-07-12 19:07:41,586 DEBUG [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily31 2023-07-12 19:07:41,586 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:41,587 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce7575edbb1d7e25bd4ed4b3e5bec644 columnFamilyName colfamily31 2023-07-12 19:07:41,587 INFO [StoreOpener-ce7575edbb1d7e25bd4ed4b3e5bec644-1] regionserver.HStore(310): Store=ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:41,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000005 2023-07-12 19:07:41,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004 2023-07-12 19:07:41,593 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 2, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=5, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000005 2023-07-12 19:07:41,593 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 673c9299883e0a0c447ecfa6b4e5e829 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 19:07:41,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004 2023-07-12 19:07:41,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing ce7575edbb1d7e25bd4ed4b3e5bec644 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004 2023-07-12 19:07:41,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004 2023-07-12 19:07:41,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e088ea3e439d4723be549ccd39a34867 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,634 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/.tmp/info/a51d491cd47947fcb2666e3b54a0c929 2023-07-12 19:07:41,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/.tmp/colfamily11/c67c62344abf47e887f8d8926337194a 2023-07-12 19:07:41,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/.tmp/colfamily11/c67c62344abf47e887f8d8926337194a as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11/c67c62344abf47e887f8d8926337194a 2023-07-12 19:07:41,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/.tmp/colfamily11/4ed91b35f1c746dba7bc1f2b50d554a8 2023-07-12 19:07:41,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/.tmp/info/a51d491cd47947fcb2666e3b54a0c929 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/info/a51d491cd47947fcb2666e3b54a0c929 2023-07-12 19:07:41,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/colfamily11/c67c62344abf47e887f8d8926337194a, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ce7575edbb1d7e25bd4ed4b3e5bec644 in 58ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/0000000000000000004 2023-07-12 19:07:41,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/info/a51d491cd47947fcb2666e3b54a0c929, entries=2, sequenceid=5, filesize=4.8 K 2023-07-12 19:07:41,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 673c9299883e0a0c447ecfa6b4e5e829 in 70ms, sequenceid=5, compaction requested=false; wal=null 2023-07-12 19:07:41,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/.tmp/colfamily11/4ed91b35f1c746dba7bc1f2b50d554a8 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily11/4ed91b35f1c746dba7bc1f2b50d554a8 2023-07-12 19:07:41,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/0000000000000000005 2023-07-12 19:07:41,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:41,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:41,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ce7575edbb1d7e25bd4ed4b3e5bec644; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64903117, jitterRate=-0.032868191599845886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ce7575edbb1d7e25bd4ed4b3e5bec644: 2023-07-12 19:07:41,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=1 2023-07-12 19:07:41,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/colfamily11/4ed91b35f1c746dba7bc1f2b50d554a8, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644., pid=88, masterSystemTime=1689188861564 2023-07-12 19:07:41,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for e088ea3e439d4723be549ccd39a34867 in 64ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,674 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 673c9299883e0a0c447ecfa6b4e5e829; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62361509, jitterRate=-0.07074110209941864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 19:07:41,674 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 673c9299883e0a0c447ecfa6b4e5e829: 2023-07-12 19:07:41,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/0000000000000000004 2023-07-12 19:07:41,675 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829., pid=79, masterSystemTime=1689188861564 2023-07-12 19:07:41,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:41,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:41,675 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,675 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861675"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861675"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861675"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861675"}]},"ts":"1689188861675"} 2023-07-12 19:07:41,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:41,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 29241abdf5ae1e6c42878fb2f5b4824c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-12 19:07:41,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:41,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,677 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:41,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,679 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=72 2023-07-12 19:07:41,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=72, state=SUCCESS; OpenRegionProcedure ce7575edbb1d7e25bd4ed4b3e5bec644, server=jenkins-hbase20.apache.org,36833,1689188708236 in 230 msec 2023-07-12 19:07:41,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:41,680 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, openSeqNum=6, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,680 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily11 2023-07-12 19:07:41,680 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily11 2023-07-12 19:07:41,680 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689188861680"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861680"}]},"ts":"1689188861680"} 2023-07-12 19:07:41,681 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29241abdf5ae1e6c42878fb2f5b4824c columnFamilyName colfamily11 2023-07-12 19:07:41,682 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(310): Store=29241abdf5ae1e6c42878fb2f5b4824c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,682 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,683 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily21 2023-07-12 19:07:41,683 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily21 2023-07-12 19:07:41,683 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29241abdf5ae1e6c42878fb2f5b4824c columnFamilyName colfamily21 2023-07-12 19:07:41,684 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(310): Store=29241abdf5ae1e6c42878fb2f5b4824c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,684 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=79, resume processing ppid=76 2023-07-12 19:07:41,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, ppid=76, state=SUCCESS; OpenRegionProcedure 673c9299883e0a0c447ecfa6b4e5e829, server=jenkins-hbase20.apache.org,36833,1689188708236 in 271 msec 2023-07-12 19:07:41,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e088ea3e439d4723be549ccd39a34867; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72480078, jitterRate=0.08003732562065125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,686 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily31 2023-07-12 19:07:41,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e088ea3e439d4723be549ccd39a34867: 2023-07-12 19:07:41,686 DEBUG [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily31 2023-07-12 19:07:41,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN in 444 msec 2023-07-12 19:07:41,687 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29241abdf5ae1e6c42878fb2f5b4824c columnFamilyName colfamily31 2023-07-12 19:07:41,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867., pid=83, masterSystemTime=1689188861570 2023-07-12 19:07:41,687 INFO [StoreOpener-29241abdf5ae1e6c42878fb2f5b4824c-1] regionserver.HStore(310): Store=29241abdf5ae1e6c42878fb2f5b4824c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN in 446 msec 2023-07-12 19:07:41,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:41,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:41,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:41,689 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0c0cdd1d4e3b41a353e9f46f7be136f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-12 19:07:41,690 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861689"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861689"}]},"ts":"1689188861689"} 2023-07-12 19:07:41,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,694 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=69 2023-07-12 19:07:41,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=69, state=SUCCESS; OpenRegionProcedure e088ea3e439d4723be549ccd39a34867, server=jenkins-hbase20.apache.org,44977,1689188708156 in 262 msec 2023-07-12 19:07:41,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,695 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11 2023-07-12 19:07:41,695 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11 2023-07-12 19:07:41,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004 2023-07-12 19:07:41,696 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0c0cdd1d4e3b41a353e9f46f7be136f columnFamilyName colfamily11 2023-07-12 19:07:41,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN in 455 msec 2023-07-12 19:07:41,696 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(310): Store=f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,697 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,697 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily21 2023-07-12 19:07:41,697 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily21 2023-07-12 19:07:41,698 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0c0cdd1d4e3b41a353e9f46f7be136f columnFamilyName colfamily21 2023-07-12 19:07:41,699 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(310): Store=f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,699 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,700 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily31 2023-07-12 19:07:41,700 DEBUG [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily31 2023-07-12 19:07:41,700 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0c0cdd1d4e3b41a353e9f46f7be136f columnFamilyName colfamily31 2023-07-12 19:07:41,701 INFO [StoreOpener-f0c0cdd1d4e3b41a353e9f46f7be136f-1] regionserver.HStore(310): Store=f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004 2023-07-12 19:07:41,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 29241abdf5ae1e6c42878fb2f5b4824c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004 2023-07-12 19:07:41,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004 2023-07-12 19:07:41,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing f0c0cdd1d4e3b41a353e9f46f7be136f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/.tmp/colfamily11/37742bc48e3543269fac567d06d3fbcc 2023-07-12 19:07:41,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/.tmp/colfamily11/37742bc48e3543269fac567d06d3fbcc as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily11/37742bc48e3543269fac567d06d3fbcc 2023-07-12 19:07:41,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/colfamily11/37742bc48e3543269fac567d06d3fbcc, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 29241abdf5ae1e6c42878fb2f5b4824c in 38ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/0000000000000000004 2023-07-12 19:07:41,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/.tmp/colfamily11/df4e390226b347d88cc711ee5e37528c 2023-07-12 19:07:41,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:41,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 29241abdf5ae1e6c42878fb2f5b4824c; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68342388, jitterRate=0.018380939960479736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 29241abdf5ae1e6c42878fb2f5b4824c: 2023-07-12 19:07:41,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c., pid=85, masterSystemTime=1689188861564 2023-07-12 19:07:41,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/.tmp/colfamily11/df4e390226b347d88cc711ee5e37528c as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11/df4e390226b347d88cc711ee5e37528c 2023-07-12 19:07:41,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:41,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:41,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:41,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 138faa52574bb0c1cc404fea49db5c75, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-12 19:07:41,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861752"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861752"}]},"ts":"1689188861752"} 2023-07-12 19:07:41,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,754 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,755 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily11 2023-07-12 19:07:41,755 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily11 2023-07-12 19:07:41,756 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 138faa52574bb0c1cc404fea49db5c75 columnFamilyName colfamily11 2023-07-12 19:07:41,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=70 2023-07-12 19:07:41,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=70, state=SUCCESS; OpenRegionProcedure 29241abdf5ae1e6c42878fb2f5b4824c, server=jenkins-hbase20.apache.org,36833,1689188708236 in 317 msec 2023-07-12 19:07:41,757 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(310): Store=138faa52574bb0c1cc404fea49db5c75/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,758 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN in 517 msec 2023-07-12 19:07:41,759 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily21 2023-07-12 19:07:41,759 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily21 2023-07-12 19:07:41,759 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 138faa52574bb0c1cc404fea49db5c75 columnFamilyName colfamily21 2023-07-12 19:07:41,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/colfamily11/df4e390226b347d88cc711ee5e37528c, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,760 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(310): Store=138faa52574bb0c1cc404fea49db5c75/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,760 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for f0c0cdd1d4e3b41a353e9f46f7be136f in 49ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/0000000000000000004 2023-07-12 19:07:41,761 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily31 2023-07-12 19:07:41,761 DEBUG [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily31 2023-07-12 19:07:41,761 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 138faa52574bb0c1cc404fea49db5c75 columnFamilyName colfamily31 2023-07-12 19:07:41,762 INFO [StoreOpener-138faa52574bb0c1cc404fea49db5c75-1] regionserver.HStore(310): Store=138faa52574bb0c1cc404fea49db5c75/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:41,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004 2023-07-12 19:07:41,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f0c0cdd1d4e3b41a353e9f46f7be136f; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59533523, jitterRate=-0.1128813773393631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f0c0cdd1d4e3b41a353e9f46f7be136f: 2023-07-12 19:07:41,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f., pid=84, masterSystemTime=1689188861570 2023-07-12 19:07:41,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:41,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:41,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:41,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb958e18b8a10f8d7d64dd6db676c171, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.', STARTKEY => 'yyy', ENDKEY => 'zzz'} 2023-07-12 19:07:41,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,770 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689188861769"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861769"}]},"ts":"1689188861769"} 2023-07-12 19:07:41,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004 2023-07-12 19:07:41,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 138faa52574bb0c1cc404fea49db5c75 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=71 2023-07-12 19:07:41,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=71, state=SUCCESS; OpenRegionProcedure f0c0cdd1d4e3b41a353e9f46f7be136f, server=jenkins-hbase20.apache.org,44977,1689188708156 in 339 msec 2023-07-12 19:07:41,775 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,777 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily11 2023-07-12 19:07:41,777 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily11 2023-07-12 19:07:41,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN in 535 msec 2023-07-12 19:07:41,777 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb958e18b8a10f8d7d64dd6db676c171 columnFamilyName colfamily11 2023-07-12 19:07:41,778 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(310): Store=eb958e18b8a10f8d7d64dd6db676c171/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,778 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,779 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily21 2023-07-12 19:07:41,779 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily21 2023-07-12 19:07:41,779 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb958e18b8a10f8d7d64dd6db676c171 columnFamilyName colfamily21 2023-07-12 19:07:41,781 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(310): Store=eb958e18b8a10f8d7d64dd6db676c171/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,781 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,782 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily31 2023-07-12 19:07:41,782 DEBUG [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily31 2023-07-12 19:07:41,783 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb958e18b8a10f8d7d64dd6db676c171 columnFamilyName colfamily31 2023-07-12 19:07:41,783 INFO [StoreOpener-eb958e18b8a10f8d7d64dd6db676c171-1] regionserver.HStore(310): Store=eb958e18b8a10f8d7d64dd6db676c171/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004 2023-07-12 19:07:41,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004 2023-07-12 19:07:41,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing eb958e18b8a10f8d7d64dd6db676c171 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/.tmp/colfamily11/bd7f98d61e154aa2ab3ddaf1c2d2b53f 2023-07-12 19:07:41,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/.tmp/colfamily11/bd7f98d61e154aa2ab3ddaf1c2d2b53f as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily11/bd7f98d61e154aa2ab3ddaf1c2d2b53f 2023-07-12 19:07:41,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/.tmp/colfamily11/5865f9c669c5484db33babb49a6d2f62 2023-07-12 19:07:41,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/colfamily11/bd7f98d61e154aa2ab3ddaf1c2d2b53f, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 138faa52574bb0c1cc404fea49db5c75 in 46ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/0000000000000000004 2023-07-12 19:07:41,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/.tmp/colfamily11/5865f9c669c5484db33babb49a6d2f62 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily11/5865f9c669c5484db33babb49a6d2f62 2023-07-12 19:07:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:41,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 138faa52574bb0c1cc404fea49db5c75; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59037553, jitterRate=-0.12027190625667572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 138faa52574bb0c1cc404fea49db5c75: 2023-07-12 19:07:41,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/colfamily11/5865f9c669c5484db33babb49a6d2f62, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for eb958e18b8a10f8d7d64dd6db676c171 in 38ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75., pid=87, masterSystemTime=1689188861564 2023-07-12 19:07:41,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/0000000000000000004 2023-07-12 19:07:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:41,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:41,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:41,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ada7efcd7f8e906f8ea0900275391d5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-12 19:07:41,832 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,832 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861831"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861831"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861831"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861831"}]},"ts":"1689188861831"} 2023-07-12 19:07:41,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,834 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,836 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily11 2023-07-12 19:07:41,858 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily11 2023-07-12 19:07:41,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:41,861 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ada7efcd7f8e906f8ea0900275391d5 columnFamilyName colfamily11 2023-07-12 19:07:41,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=73 2023-07-12 19:07:41,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=73, state=SUCCESS; OpenRegionProcedure 138faa52574bb0c1cc404fea49db5c75, server=jenkins-hbase20.apache.org,36833,1689188708236 in 390 msec 2023-07-12 19:07:41,866 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(310): Store=9ada7efcd7f8e906f8ea0900275391d5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,866 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN in 624 msec 2023-07-12 19:07:41,867 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily21 2023-07-12 19:07:41,867 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily21 2023-07-12 19:07:41,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,868 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ada7efcd7f8e906f8ea0900275391d5 columnFamilyName colfamily21 2023-07-12 19:07:41,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened eb958e18b8a10f8d7d64dd6db676c171; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61555091, jitterRate=-0.08275766670703888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for eb958e18b8a10f8d7d64dd6db676c171: 2023-07-12 19:07:41,869 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(310): Store=9ada7efcd7f8e906f8ea0900275391d5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,869 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171., pid=80, masterSystemTime=1689188861570 2023-07-12 19:07:41,875 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily31 2023-07-12 19:07:41,875 DEBUG [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily31 2023-07-12 19:07:41,876 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ada7efcd7f8e906f8ea0900275391d5 columnFamilyName colfamily31 2023-07-12 19:07:41,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:41,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:41,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:41,876 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=78 updating hbase:meta row=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 857f7f7098ef081088fbf17dc14c7fab, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-12 19:07:41,877 INFO [StoreOpener-9ada7efcd7f8e906f8ea0900275391d5-1] regionserver.HStore(310): Store=9ada7efcd7f8e906f8ea0900275391d5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,877 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861876"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861876"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861876"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861876"}]},"ts":"1689188861876"} 2023-07-12 19:07:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,879 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,880 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily11 2023-07-12 19:07:41,880 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily11 2023-07-12 19:07:41,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004 2023-07-12 19:07:41,880 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 857f7f7098ef081088fbf17dc14c7fab columnFamilyName colfamily11 2023-07-12 19:07:41,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=78 2023-07-12 19:07:41,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=78, state=SUCCESS; OpenRegionProcedure eb958e18b8a10f8d7d64dd6db676c171, server=jenkins-hbase20.apache.org,44977,1689188708156 in 461 msec 2023-07-12 19:07:41,881 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(310): Store=857f7f7098ef081088fbf17dc14c7fab/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,881 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN in 640 msec 2023-07-12 19:07:41,883 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily21 2023-07-12 19:07:41,883 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily21 2023-07-12 19:07:41,883 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 857f7f7098ef081088fbf17dc14c7fab columnFamilyName colfamily21 2023-07-12 19:07:41,884 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(310): Store=857f7f7098ef081088fbf17dc14c7fab/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,884 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,885 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily31 2023-07-12 19:07:41,885 DEBUG [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily31 2023-07-12 19:07:41,885 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 857f7f7098ef081088fbf17dc14c7fab columnFamilyName colfamily31 2023-07-12 19:07:41,886 INFO [StoreOpener-857f7f7098ef081088fbf17dc14c7fab-1] regionserver.HStore(310): Store=857f7f7098ef081088fbf17dc14c7fab/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004 2023-07-12 19:07:41,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 9ada7efcd7f8e906f8ea0900275391d5 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004 2023-07-12 19:07:41,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004 2023-07-12 19:07:41,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 857f7f7098ef081088fbf17dc14c7fab 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/.tmp/colfamily11/c5c7d8adb7e34ee5af7b0d5cff82c47e 2023-07-12 19:07:41,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/.tmp/colfamily11/c5c7d8adb7e34ee5af7b0d5cff82c47e as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily11/c5c7d8adb7e34ee5af7b0d5cff82c47e 2023-07-12 19:07:41,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/.tmp/colfamily11/08ab4d1c3e2b40a7aa4fb9a5b80a1ea5 2023-07-12 19:07:41,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/colfamily11/c5c7d8adb7e34ee5af7b0d5cff82c47e, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 9ada7efcd7f8e906f8ea0900275391d5 in 39ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/0000000000000000004 2023-07-12 19:07:41,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/.tmp/colfamily11/08ab4d1c3e2b40a7aa4fb9a5b80a1ea5 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily11/08ab4d1c3e2b40a7aa4fb9a5b80a1ea5 2023-07-12 19:07:41,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:41,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/colfamily11/08ab4d1c3e2b40a7aa4fb9a5b80a1ea5, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 857f7f7098ef081088fbf17dc14c7fab in 40ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/0000000000000000004 2023-07-12 19:07:41,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9ada7efcd7f8e906f8ea0900275391d5; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63346174, jitterRate=-0.05606845021247864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9ada7efcd7f8e906f8ea0900275391d5: 2023-07-12 19:07:41,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5., pid=86, masterSystemTime=1689188861564 2023-07-12 19:07:41,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:41,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:41,939 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:41,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861939"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861939"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861939"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861939"}]},"ts":"1689188861939"} 2023-07-12 19:07:41,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:41,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=74 2023-07-12 19:07:41,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=74, state=SUCCESS; OpenRegionProcedure 9ada7efcd7f8e906f8ea0900275391d5, server=jenkins-hbase20.apache.org,36833,1689188708236 in 500 msec 2023-07-12 19:07:41,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN in 702 msec 2023-07-12 19:07:41,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 857f7f7098ef081088fbf17dc14c7fab; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62033132, jitterRate=-0.07563430070877075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 857f7f7098ef081088fbf17dc14c7fab: 2023-07-12 19:07:41,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab., pid=82, masterSystemTime=1689188861570 2023-07-12 19:07:41,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:41,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:41,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b33686861752ae5f44ef84731832666f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.', STARTKEY => 'vvv', ENDKEY => 'www'} 2023-07-12 19:07:41,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 19:07:41,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188861947"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188861947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188861947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188861947"}]},"ts":"1689188861947"} 2023-07-12 19:07:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,950 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,951 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily11 2023-07-12 19:07:41,951 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily11 2023-07-12 19:07:41,952 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b33686861752ae5f44ef84731832666f columnFamilyName colfamily11 2023-07-12 19:07:41,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=75 2023-07-12 19:07:41,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=75, state=SUCCESS; OpenRegionProcedure 857f7f7098ef081088fbf17dc14c7fab, server=jenkins-hbase20.apache.org,44977,1689188708156 in 523 msec 2023-07-12 19:07:41,952 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(310): Store=b33686861752ae5f44ef84731832666f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,952 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,953 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily21 2023-07-12 19:07:41,953 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily21 2023-07-12 19:07:41,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN in 711 msec 2023-07-12 19:07:41,954 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b33686861752ae5f44ef84731832666f columnFamilyName colfamily21 2023-07-12 19:07:41,954 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(310): Store=b33686861752ae5f44ef84731832666f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,954 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,955 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily31 2023-07-12 19:07:41,955 DEBUG [StoreOpener-b33686861752ae5f44ef84731832666f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily31 2023-07-12 19:07:41,956 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b33686861752ae5f44ef84731832666f columnFamilyName colfamily31 2023-07-12 19:07:41,956 INFO [StoreOpener-b33686861752ae5f44ef84731832666f-1] regionserver.HStore(310): Store=b33686861752ae5f44ef84731832666f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 19:07:41,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004 2023-07-12 19:07:41,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004 2023-07-12 19:07:41,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing b33686861752ae5f44ef84731832666f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:41,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/.tmp/colfamily11/65ff4008b9b74055a66123f39da37034 2023-07-12 19:07:41,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/.tmp/colfamily11/65ff4008b9b74055a66123f39da37034 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily11/65ff4008b9b74055a66123f39da37034 2023-07-12 19:07:41,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/colfamily11/65ff4008b9b74055a66123f39da37034, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 19:07:41,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for b33686861752ae5f44ef84731832666f in 27ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 19:07:41,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/0000000000000000004 2023-07-12 19:07:41,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 19:07:41,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b33686861752ae5f44ef84731832666f 2023-07-12 19:07:41,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 19:07:41,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b33686861752ae5f44ef84731832666f; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70322863, jitterRate=0.04789231717586517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 19:07:41,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b33686861752ae5f44ef84731832666f: 2023-07-12 19:07:41,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f., pid=81, masterSystemTime=1689188861570 2023-07-12 19:07:42,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:42,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:42,001 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=b33686861752ae5f44ef84731832666f, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,002 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689188862001"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689188862001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689188862001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689188862001"}]},"ts":"1689188862001"} 2023-07-12 19:07:42,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=77 2023-07-12 19:07:42,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=77, state=SUCCESS; OpenRegionProcedure b33686861752ae5f44ef84731832666f, server=jenkins-hbase20.apache.org,44977,1689188708156 in 580 msec 2023-07-12 19:07:42,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=62 2023-07-12 19:07:42,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN in 764 msec 2023-07-12 19:07:42,006 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,35281,1689188708201 after splitting done 2023-07-12 19:07:42,006 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase20.apache.org,35281,1689188708201 from processing; numProcessing=0 2023-07-12 19:07:42,006 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 19:07:42,006 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:42,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:07:42,006 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 19:07:42,240 INFO [Listener at localhost.localdomain/45243] procedure.MasterProcedureTestingUtility(454): Restart 8 exec state=pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:42,240 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 19:07:42,241 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:07:42,241 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:07:42,242 ERROR [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:07:42,243 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 19:07:42,243 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 19:07:42,243 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 19:07:42,244 INFO [Listener at localhost.localdomain/45243] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 19:07:42,246 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-12 19:07:42,247 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25, 26, 27] 2023-07-12 19:07:42,247 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 19:07:42,247 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=69, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[37, 46, 63] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=83, ppid=69, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[47, 62] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=70, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[36, 50, 65] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=85, ppid=70, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[51, 64] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=71, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[35, 48, 67] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=84, ppid=71, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[49, 66] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=72, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[34, 56, 61] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=88, ppid=72, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[57, 58] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=73, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[33, 54, 69] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=87, ppid=73, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[55, 68] 2023-07-12 19:07:42,248 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=74, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[32, 52, 73] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=86, ppid=74, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[53, 72] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=75, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[31, 44, 75] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=82, ppid=75, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[45, 74] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=76, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[28, 38, 60] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=79, ppid=76, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[39, 59] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=77, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[30, 42, 77] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=81, ppid=77, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[43, 76] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=78, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[29, 40, 71] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=80, ppid=78, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[41, 70] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 19:07:42,249 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 19:07:42,250 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 19:07:42,250 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 19:07:42,250 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 19:07:42,251 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 19:07:42,253 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN 2023-07-12 19:07:42,254 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN 2023-07-12 19:07:42,255 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN 2023-07-12 19:07:42,255 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN 2023-07-12 19:07:42,255 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=79, ppid=76, state=SUCCESS; OpenRegionProcedure 673c9299883e0a0c447ecfa6b4e5e829, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:42,255 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=80, ppid=78, state=SUCCESS; OpenRegionProcedure eb958e18b8a10f8d7d64dd6db676c171, server=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,255 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=81, ppid=77, state=SUCCESS; OpenRegionProcedure b33686861752ae5f44ef84731832666f, server=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,255 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=82, ppid=75, state=SUCCESS; OpenRegionProcedure 857f7f7098ef081088fbf17dc14c7fab, server=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=83, ppid=69, state=SUCCESS; OpenRegionProcedure e088ea3e439d4723be549ccd39a34867, server=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=84, ppid=71, state=SUCCESS; OpenRegionProcedure f0c0cdd1d4e3b41a353e9f46f7be136f, server=jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=85, ppid=70, state=SUCCESS; OpenRegionProcedure 29241abdf5ae1e6c42878fb2f5b4824c, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=86, ppid=74, state=SUCCESS; OpenRegionProcedure 9ada7efcd7f8e906f8ea0900275391d5, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=87, ppid=73, state=SUCCESS; OpenRegionProcedure 138faa52574bb0c1cc404fea49db5c75, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(468): Loading pid=88, ppid=72, state=SUCCESS; OpenRegionProcedure ce7575edbb1d7e25bd4ed4b3e5bec644, server=jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.meta.1689188709817.meta, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,257 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C35281%2C1689188708201.1689188709626, worker=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e088ea3e439d4723be549ccd39a34867, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=29241abdf5ae1e6c42878fb2f5b4824c, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f0c0cdd1d4e3b41a353e9f46f7be136f, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ce7575edbb1d7e25bd4ed4b3e5bec644, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=138faa52574bb0c1cc404fea49db5c75, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9ada7efcd7f8e906f8ea0900275391d5, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=857f7f7098ef081088fbf17dc14c7fab, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=673c9299883e0a0c447ecfa6b4e5e829, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b33686861752ae5f44ef84731832666f, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,258 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=eb958e18b8a10f8d7d64dd6db676c171, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=79, ppid=76, state=SUCCESS; OpenRegionProcedure 673c9299883e0a0c447ecfa6b4e5e829, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=80, ppid=78, state=SUCCESS; OpenRegionProcedure eb958e18b8a10f8d7d64dd6db676c171, server=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=81, ppid=77, state=SUCCESS; OpenRegionProcedure b33686861752ae5f44ef84731832666f, server=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=82, ppid=75, state=SUCCESS; OpenRegionProcedure 857f7f7098ef081088fbf17dc14c7fab, server=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=83, ppid=69, state=SUCCESS; OpenRegionProcedure e088ea3e439d4723be549ccd39a34867, server=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=84, ppid=71, state=SUCCESS; OpenRegionProcedure f0c0cdd1d4e3b41a353e9f46f7be136f, server=jenkins-hbase20.apache.org,44977,1689188708156 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=85, ppid=70, state=SUCCESS; OpenRegionProcedure 29241abdf5ae1e6c42878fb2f5b4824c, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=86, ppid=74, state=SUCCESS; OpenRegionProcedure 9ada7efcd7f8e906f8ea0900275391d5, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=87, ppid=73, state=SUCCESS; OpenRegionProcedure 138faa52574bb0c1cc404fea49db5c75, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,259 DEBUG [Listener at localhost.localdomain/45243] procedure2.Procedure(946): pid=88, ppid=72, state=SUCCESS; OpenRegionProcedure ce7575edbb1d7e25bd4ed4b3e5bec644, server=jenkins-hbase20.apache.org,36833,1689188708236 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 19:07:42,260 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 13 msec 2023-07-12 19:07:42,260 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 19:07:42,261 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,36833,1689188708236, table=hbase:meta, region=1588230740 2023-07-12 19:07:42,261 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689188892261 2023-07-12 19:07:42,263 DEBUG [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 19:07:42,263 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35281,1689188708201; numProcessing=1 2023-07-12 19:07:42,270 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=673c9299883e0a0c447ecfa6b4e5e829, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=6 2023-07-12 19:07:42,270 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=f0c0cdd1d4e3b41a353e9f46f7be136f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=5 2023-07-12 19:07:42,270 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=d553d6a56ac1a02eae16d402efdad87b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,271 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cb90a60b65f36d3a89e67ce23d6e1791, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,271 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=a5ff2fcd2829ecc44f00cc2c00bb23ef, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,271 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ce7575edbb1d7e25bd4ed4b3e5bec644, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=5 2023-07-12 19:07:42,272 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eea56a3c84bac34483f036ea38341f7c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,272 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=c7f9802929d88c18bd6a77756ccfe2c6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,272 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=4a0484dfe1e175ac58ae3850727dd3da, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,272 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e088ea3e439d4723be549ccd39a34867, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=5 2023-07-12 19:07:42,273 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=cba88346293ad1a9e4c0962a37c6a3a9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,273 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=138faa52574bb0c1cc404fea49db5c75, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=5 2023-07-12 19:07:42,273 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=ecd2244642d3eaca1773ab751ae2cf01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,274 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=857f7f7098ef081088fbf17dc14c7fab, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=5 2023-07-12 19:07:42,274 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=fcabfbbd6b823ca7d698a0d8ec022fe9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,274 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=834e5d1c859395db9fa09f16bbadb6fe, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,274 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=e07929b49eb60c0014549c0b944194b1, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,275 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=3932389baa9a41fc2c9f3bd588489325, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,275 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=40193bfd281f2b2f7b454fbd94bd1f72, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,275 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=9ada7efcd7f8e906f8ea0900275391d5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=5 2023-07-12 19:07:42,275 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=7a1bb0c5c6eb58e18ca831f4992c1f5f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,275 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=1d3260808db8616b1e8580567e7ef724, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,276 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b33686861752ae5f44ef84731832666f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=5 2023-07-12 19:07:42,276 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=b9624170c6f0cf6a78f1fab36d60b756, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=2 2023-07-12 19:07:42,276 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=29241abdf5ae1e6c42878fb2f5b4824c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,36833,1689188708236, regionLocation=jenkins-hbase20.apache.org,36833,1689188708236, openSeqNum=5 2023-07-12 19:07:42,276 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=eb958e18b8a10f8d7d64dd6db676c171, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=5 2023-07-12 19:07:42,276 DEBUG [Listener at localhost.localdomain/45243] assignment.RegionStateStore(147): Load hbase:meta entry region=67ebaa1418ea2c26ad1d3745ebac5f37, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44977,1689188708156, regionLocation=jenkins-hbase20.apache.org,44977,1689188708156, openSeqNum=2 2023-07-12 19:07:42,276 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 19:07:42,276 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689188922276 2023-07-12 19:07:42,277 INFO [Listener at localhost.localdomain/45243] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689188982277 2023-07-12 19:07:42,277 INFO [Listener at localhost.localdomain/45243] assignment.AssignmentManager(1536): Joined the cluster in 14 msec 2023-07-12 19:07:42,277 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,35281,1689188708201 after splitting done 2023-07-12 19:07:42,277 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase20.apache.org,35281,1689188708201 from processing; numProcessing=0 2023-07-12 19:07:42,277 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 19:07:42,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,35281,1689188708201, splitWal=true, meta=true in 2 mins, 28.156 sec 2023-07-12 19:07:42,531 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 19:07:42,541 WARN [RPCClient-NioEventLoopGroup-6-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:35281 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 19:07:42,543 DEBUG [RPCClient-NioEventLoopGroup-6-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:35281 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:35281 2023-07-12 19:07:42,645 DEBUG [hconnection-0x7fc3471e-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:42,760 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 19:07:42,768 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 19:07:42,781 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 19:07:42,786 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 19:07:42,790 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 19:07:42,795 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 19:07:42,795 DEBUG [hconnection-0x7fc3471e-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:42,912 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 19:07:42,918 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 19:07:42,924 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 19:07:42,929 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 19:07:42,930 DEBUG [hconnection-0x7fc3471e-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:43,043 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 19:07:43,048 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 19:07:43,048 DEBUG [hconnection-0x7fc3471e-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:43,164 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 19:07:43,168 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 19:07:43,168 DEBUG [hconnection-0x7fc3471e-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:43,286 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 19:07:43,291 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 19:07:43,295 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 19:07:43,299 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 19:07:43,303 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 19:07:43,306 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 19:07:43,307 DEBUG [hconnection-0x7fc3471e-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:43,421 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 19:07:43,425 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 19:07:43,427 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 19:07:43,428 DEBUG [hconnection-0x7fc3471e-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:43,544 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 19:07:43,547 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 19:07:43,548 DEBUG [hconnection-0x7fc3471e-shared-pool-11] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:43,661 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 19:07:43,662 DEBUG [hconnection-0x7fc3471e-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:35281 this server is in the failed servers list 2023-07-12 19:07:43,779 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 19:07:43,787 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 19:07:43,791 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 19:07:43,796 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 19:07:43,799 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 19:07:43,803 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 19:07:43,807 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 19:07:43,810 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 19:07:43,814 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 19:07:43,817 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 19:07:43,820 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 19:07:43,824 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 19:07:43,828 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 19:07:43,831 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 19:07:43,834 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 19:07:43,837 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 19:07:43,841 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 19:07:43,845 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 19:07:43,848 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 19:07:43,852 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 19:07:43,856 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 19:07:43,859 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 19:07:43,862 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 19:07:43,865 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 19:07:43,869 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 19:07:43,873 DEBUG [Listener at localhost.localdomain/45243] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 19:07:43,880 WARN [Listener at localhost.localdomain/45243] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-12 19:07:43,880 INFO [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 19:07:43,880 INFO [Listener at localhost.localdomain/45243] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 19:07:43,881 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x455c5a4c to 127.0.0.1:62537 2023-07-12 19:07:43,881 DEBUG [Listener at localhost.localdomain/45243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:07:43,882 DEBUG [Listener at localhost.localdomain/45243] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 19:07:43,882 DEBUG [Listener at localhost.localdomain/45243] util.JVMClusterUtil(257): Found active master hash=2067552401, stopped=false 2023-07-12 19:07:43,882 INFO [Listener at localhost.localdomain/45243] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:07:43,885 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 19:07:43,885 INFO [Listener at localhost.localdomain/45243] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 19:07:43,885 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 19:07:43,885 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 19:07:43,887 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:07:43,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 19:07:43,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 19:07:43,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 19:07:43,888 DEBUG [Listener at localhost.localdomain/45243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ca57b17 to 127.0.0.1:62537 2023-07-12 19:07:43,889 DEBUG [Listener at localhost.localdomain/45243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:07:43,889 INFO [Listener at localhost.localdomain/45243] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44977,1689188708156' ***** 2023-07-12 19:07:43,889 INFO [Listener at localhost.localdomain/45243] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 19:07:43,889 INFO [Listener at localhost.localdomain/45243] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36833,1689188708236' ***** 2023-07-12 19:07:43,889 INFO [Listener at localhost.localdomain/45243] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 19:07:43,889 INFO [RS:0;jenkins-hbase20:44977] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 19:07:43,890 INFO [RS:2;jenkins-hbase20:36833] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 19:07:43,890 INFO [RS:0;jenkins-hbase20:44977] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 19:07:43,890 INFO [RS:2;jenkins-hbase20:36833] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 19:07:43,890 INFO [RS:0;jenkins-hbase20:44977] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 19:07:43,890 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 19:07:43,890 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 19:07:43,890 INFO [RS:2;jenkins-hbase20:36833] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 19:07:43,891 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:07:43,891 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 9ada7efcd7f8e906f8ea0900275391d5 2023-07-12 19:07:43,891 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for 834e5d1c859395db9fa09f16bbadb6fe 2023-07-12 19:07:43,891 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for c7f9802929d88c18bd6a77756ccfe2c6 2023-07-12 19:07:43,891 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for 67ebaa1418ea2c26ad1d3745ebac5f37 2023-07-12 19:07:43,891 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for 857f7f7098ef081088fbf17dc14c7fab 2023-07-12 19:07:43,892 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for b33686861752ae5f44ef84731832666f 2023-07-12 19:07:43,892 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for 1d3260808db8616b1e8580567e7ef724 2023-07-12 19:07:43,892 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for e088ea3e439d4723be549ccd39a34867 2023-07-12 19:07:43,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fcabfbbd6b823ca7d698a0d8ec022fe9, disabling compactions & flushes 2023-07-12 19:07:43,892 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 7a1bb0c5c6eb58e18ca831f4992c1f5f 2023-07-12 19:07:43,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:07:43,892 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for a5ff2fcd2829ecc44f00cc2c00bb23ef 2023-07-12 19:07:43,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:07:43,893 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:43,893 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:07:43,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9ada7efcd7f8e906f8ea0900275391d5, disabling compactions & flushes 2023-07-12 19:07:43,893 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 138faa52574bb0c1cc404fea49db5c75 2023-07-12 19:07:43,893 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for 40193bfd281f2b2f7b454fbd94bd1f72 2023-07-12 19:07:43,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. after waiting 0 ms 2023-07-12 19:07:43,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:07:43,893 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for cba88346293ad1a9e4c0962a37c6a3a9 2023-07-12 19:07:43,893 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for b9624170c6f0cf6a78f1fab36d60b756 2023-07-12 19:07:43,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:43,893 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for cb90a60b65f36d3a89e67ce23d6e1791 2023-07-12 19:07:43,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing fcabfbbd6b823ca7d698a0d8ec022fe9 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:43,893 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:43,893 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 673c9299883e0a0c447ecfa6b4e5e829 2023-07-12 19:07:43,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:43,894 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 29241abdf5ae1e6c42878fb2f5b4824c 2023-07-12 19:07:43,893 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(3305): Received CLOSE for d553d6a56ac1a02eae16d402efdad87b 2023-07-12 19:07:43,894 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 3932389baa9a41fc2c9f3bd588489325 2023-07-12 19:07:43,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. after waiting 0 ms 2023-07-12 19:07:43,894 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for e07929b49eb60c0014549c0b944194b1 2023-07-12 19:07:43,894 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:43,894 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:07:43,894 DEBUG [RS:0;jenkins-hbase20:44977] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x604d95ab to 127.0.0.1:62537 2023-07-12 19:07:43,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:43,894 DEBUG [RS:0;jenkins-hbase20:44977] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:07:43,894 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 4a0484dfe1e175ac58ae3850727dd3da 2023-07-12 19:07:43,895 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1474): Waiting on 14 regions to close 2023-07-12 19:07:43,895 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:43,895 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:43,895 DEBUG [RS:2;jenkins-hbase20:36833] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x754bb73f to 127.0.0.1:62537 2023-07-12 19:07:43,895 DEBUG [RS:2;jenkins-hbase20:36833] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:07:43,897 INFO [RS:2;jenkins-hbase20:36833] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 19:07:43,897 INFO [RS:2;jenkins-hbase20:36833] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 19:07:43,897 INFO [RS:2;jenkins-hbase20:36833] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 19:07:43,897 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 19:07:43,897 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1474): Waiting on 14 regions to close 2023-07-12 19:07:43,898 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1504): Waiting on 1d3260808db8616b1e8580567e7ef724, 40193bfd281f2b2f7b454fbd94bd1f72, 67ebaa1418ea2c26ad1d3745ebac5f37, 834e5d1c859395db9fa09f16bbadb6fe, 857f7f7098ef081088fbf17dc14c7fab, a5ff2fcd2829ecc44f00cc2c00bb23ef, b33686861752ae5f44ef84731832666f, c7f9802929d88c18bd6a77756ccfe2c6, cba88346293ad1a9e4c0962a37c6a3a9, d553d6a56ac1a02eae16d402efdad87b, e088ea3e439d4723be549ccd39a34867, eb958e18b8a10f8d7d64dd6db676c171, f0c0cdd1d4e3b41a353e9f46f7be136f, fcabfbbd6b823ca7d698a0d8ec022fe9 2023-07-12 19:07:43,898 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1504): Waiting on 138faa52574bb0c1cc404fea49db5c75, 1588230740, 29241abdf5ae1e6c42878fb2f5b4824c, 3932389baa9a41fc2c9f3bd588489325, 4a0484dfe1e175ac58ae3850727dd3da, 673c9299883e0a0c447ecfa6b4e5e829, 7a1bb0c5c6eb58e18ca831f4992c1f5f, 9ada7efcd7f8e906f8ea0900275391d5, b9624170c6f0cf6a78f1fab36d60b756, cb90a60b65f36d3a89e67ce23d6e1791, ce7575edbb1d7e25bd4ed4b3e5bec644, e07929b49eb60c0014549c0b944194b1, ecd2244642d3eaca1773ab751ae2cf01, eea56a3c84bac34483f036ea38341f7c 2023-07-12 19:07:43,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 19:07:43,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 19:07:43,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 19:07:43,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 19:07:43,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 19:07:43,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.55 KB heapSize=21.16 KB 2023-07-12 19:07:43,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9ada7efcd7f8e906f8ea0900275391d5/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:43,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:43,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9ada7efcd7f8e906f8ea0900275391d5: 2023-07-12 19:07:43,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689188710937.9ada7efcd7f8e906f8ea0900275391d5. 2023-07-12 19:07:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7a1bb0c5c6eb58e18ca831f4992c1f5f, disabling compactions & flushes 2023-07-12 19:07:43,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:07:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:07:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. after waiting 0 ms 2023-07-12 19:07:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:07:43,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 7a1bb0c5c6eb58e18ca831f4992c1f5f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:43,931 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 19:07:43,931 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 19:07:43,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=14.55 KB at sequenceid=86 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/.tmp/info/35ec5bf466874a6c9b869f1d29699bef 2023-07-12 19:07:43,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/.tmp/colfamily11/f0f37102f4614a4fb8c871e4ff036842 2023-07-12 19:07:43,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/.tmp/colfamily11/46ea0c7f49304483bcea108624e93ee1 2023-07-12 19:07:43,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/.tmp/colfamily11/f0f37102f4614a4fb8c871e4ff036842 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily11/f0f37102f4614a4fb8c871e4ff036842 2023-07-12 19:07:43,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/.tmp/info/35ec5bf466874a6c9b869f1d29699bef as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info/35ec5bf466874a6c9b869f1d29699bef 2023-07-12 19:07:43,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/.tmp/colfamily11/46ea0c7f49304483bcea108624e93ee1 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily11/46ea0c7f49304483bcea108624e93ee1 2023-07-12 19:07:43,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/colfamily11/f0f37102f4614a4fb8c871e4ff036842, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:43,971 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/info/35ec5bf466874a6c9b869f1d29699bef, entries=80, sequenceid=86, filesize=19.5 K 2023-07-12 19:07:43,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.55 KB/14898, heapSize ~20.65 KB/21144, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=86, compaction requested=false 2023-07-12 19:07:43,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for fcabfbbd6b823ca7d698a0d8ec022fe9 in 79ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:43,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/meta/1588230740/recovered.edits/89.seqid, newMaxSeqId=89, maxSeqId=63 2023-07-12 19:07:43,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fcabfbbd6b823ca7d698a0d8ec022fe9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:43,981 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 19:07:43,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:07:43,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fcabfbbd6b823ca7d698a0d8ec022fe9: 2023-07-12 19:07:43,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689188710937.fcabfbbd6b823ca7d698a0d8ec022fe9. 2023-07-12 19:07:43,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 834e5d1c859395db9fa09f16bbadb6fe, disabling compactions & flushes 2023-07-12 19:07:43,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 19:07:43,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:07:43,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 19:07:43,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 19:07:43,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:07:43,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. after waiting 0 ms 2023-07-12 19:07:43,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/colfamily11/46ea0c7f49304483bcea108624e93ee1, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:43,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:07:43,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 834e5d1c859395db9fa09f16bbadb6fe 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:43,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 7a1bb0c5c6eb58e18ca831f4992c1f5f in 76ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:43,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/7a1bb0c5c6eb58e18ca831f4992c1f5f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:43,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:07:43,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7a1bb0c5c6eb58e18ca831f4992c1f5f: 2023-07-12 19:07:43,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689188710937.7a1bb0c5c6eb58e18ca831f4992c1f5f. 2023-07-12 19:07:43,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing eea56a3c84bac34483f036ea38341f7c, disabling compactions & flushes 2023-07-12 19:07:43,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:07:43,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:07:43,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. after waiting 0 ms 2023-07-12 19:07:43,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:07:43,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing eea56a3c84bac34483f036ea38341f7c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/.tmp/colfamily11/6c48d7b4d1864d4a8f33361b8c7079fe 2023-07-12 19:07:44,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/.tmp/colfamily11/dc7a864ef06d433896cd6e8bdc84cea8 2023-07-12 19:07:44,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/.tmp/colfamily11/6c48d7b4d1864d4a8f33361b8c7079fe as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily11/6c48d7b4d1864d4a8f33361b8c7079fe 2023-07-12 19:07:44,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/.tmp/colfamily11/dc7a864ef06d433896cd6e8bdc84cea8 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily11/dc7a864ef06d433896cd6e8bdc84cea8 2023-07-12 19:07:44,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/colfamily11/6c48d7b4d1864d4a8f33361b8c7079fe, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 834e5d1c859395db9fa09f16bbadb6fe in 41ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/834e5d1c859395db9fa09f16bbadb6fe/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:07:44,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 834e5d1c859395db9fa09f16bbadb6fe: 2023-07-12 19:07:44,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689188710937.834e5d1c859395db9fa09f16bbadb6fe. 2023-07-12 19:07:44,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c7f9802929d88c18bd6a77756ccfe2c6, disabling compactions & flushes 2023-07-12 19:07:44,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:07:44,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:07:44,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. after waiting 0 ms 2023-07-12 19:07:44,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/colfamily11/dc7a864ef06d433896cd6e8bdc84cea8, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:07:44,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing c7f9802929d88c18bd6a77756ccfe2c6 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for eea56a3c84bac34483f036ea38341f7c in 41ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eea56a3c84bac34483f036ea38341f7c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:07:44,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for eea56a3c84bac34483f036ea38341f7c: 2023-07-12 19:07:44,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689188710937.eea56a3c84bac34483f036ea38341f7c. 2023-07-12 19:07:44,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 138faa52574bb0c1cc404fea49db5c75, disabling compactions & flushes 2023-07-12 19:07:44,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:44,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:44,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. after waiting 0 ms 2023-07-12 19:07:44,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:44,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/138faa52574bb0c1cc404fea49db5c75/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:44,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 138faa52574bb0c1cc404fea49db5c75: 2023-07-12 19:07:44,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689188710937.138faa52574bb0c1cc404fea49db5c75. 2023-07-12 19:07:44,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b9624170c6f0cf6a78f1fab36d60b756, disabling compactions & flushes 2023-07-12 19:07:44,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:07:44,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:07:44,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. after waiting 0 ms 2023-07-12 19:07:44,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:07:44,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing b9624170c6f0cf6a78f1fab36d60b756 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/.tmp/colfamily11/22e92ac57936422ba10dcf6f44b540d4 2023-07-12 19:07:44,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/.tmp/colfamily11/22e92ac57936422ba10dcf6f44b540d4 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily11/22e92ac57936422ba10dcf6f44b540d4 2023-07-12 19:07:44,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/.tmp/colfamily11/4d4952beeff141a8b85fda04de44a14b 2023-07-12 19:07:44,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/colfamily11/22e92ac57936422ba10dcf6f44b540d4, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for c7f9802929d88c18bd6a77756ccfe2c6 in 46ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/.tmp/colfamily11/4d4952beeff141a8b85fda04de44a14b as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily11/4d4952beeff141a8b85fda04de44a14b 2023-07-12 19:07:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c7f9802929d88c18bd6a77756ccfe2c6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:07:44,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c7f9802929d88c18bd6a77756ccfe2c6: 2023-07-12 19:07:44,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689188710937.c7f9802929d88c18bd6a77756ccfe2c6. 2023-07-12 19:07:44,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 67ebaa1418ea2c26ad1d3745ebac5f37, disabling compactions & flushes 2023-07-12 19:07:44,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:07:44,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:07:44,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. after waiting 0 ms 2023-07-12 19:07:44,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:07:44,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 67ebaa1418ea2c26ad1d3745ebac5f37 3/3 column families, dataSize=48 B heapSize=888 B 2023-07-12 19:07:44,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/colfamily11/4d4952beeff141a8b85fda04de44a14b, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for b9624170c6f0cf6a78f1fab36d60b756 in 39ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,098 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1504): Waiting on 1d3260808db8616b1e8580567e7ef724, 40193bfd281f2b2f7b454fbd94bd1f72, 67ebaa1418ea2c26ad1d3745ebac5f37, 857f7f7098ef081088fbf17dc14c7fab, a5ff2fcd2829ecc44f00cc2c00bb23ef, b33686861752ae5f44ef84731832666f, cba88346293ad1a9e4c0962a37c6a3a9, d553d6a56ac1a02eae16d402efdad87b, e088ea3e439d4723be549ccd39a34867, eb958e18b8a10f8d7d64dd6db676c171, f0c0cdd1d4e3b41a353e9f46f7be136f 2023-07-12 19:07:44,098 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1504): Waiting on 29241abdf5ae1e6c42878fb2f5b4824c, 3932389baa9a41fc2c9f3bd588489325, 4a0484dfe1e175ac58ae3850727dd3da, 673c9299883e0a0c447ecfa6b4e5e829, b9624170c6f0cf6a78f1fab36d60b756, cb90a60b65f36d3a89e67ce23d6e1791, ce7575edbb1d7e25bd4ed4b3e5bec644, e07929b49eb60c0014549c0b944194b1, ecd2244642d3eaca1773ab751ae2cf01 2023-07-12 19:07:44,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b9624170c6f0cf6a78f1fab36d60b756/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:07:44,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b9624170c6f0cf6a78f1fab36d60b756: 2023-07-12 19:07:44,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689188710937.b9624170c6f0cf6a78f1fab36d60b756. 2023-07-12 19:07:44,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cb90a60b65f36d3a89e67ce23d6e1791, disabling compactions & flushes 2023-07-12 19:07:44,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:07:44,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:07:44,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. after waiting 0 ms 2023-07-12 19:07:44,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:07:44,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing cb90a60b65f36d3a89e67ce23d6e1791 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48 B at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/.tmp/colfamily11/4fba40e746fc4a949daf01cc071d15f4 2023-07-12 19:07:44,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/.tmp/colfamily11/4fba40e746fc4a949daf01cc071d15f4 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily11/4fba40e746fc4a949daf01cc071d15f4 2023-07-12 19:07:44,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/.tmp/colfamily11/b3664bfb2dea4f7ab27699e65bcb5eb3 2023-07-12 19:07:44,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/colfamily11/4fba40e746fc4a949daf01cc071d15f4, entries=1, sequenceid=5, filesize=4.6 K 2023-07-12 19:07:44,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 67ebaa1418ea2c26ad1d3745ebac5f37 in 38ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/.tmp/colfamily11/b3664bfb2dea4f7ab27699e65bcb5eb3 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily11/b3664bfb2dea4f7ab27699e65bcb5eb3 2023-07-12 19:07:44,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/67ebaa1418ea2c26ad1d3745ebac5f37/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:07:44,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 67ebaa1418ea2c26ad1d3745ebac5f37: 2023-07-12 19:07:44,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689188710937.67ebaa1418ea2c26ad1d3745ebac5f37. 2023-07-12 19:07:44,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 857f7f7098ef081088fbf17dc14c7fab, disabling compactions & flushes 2023-07-12 19:07:44,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:44,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:44,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. after waiting 0 ms 2023-07-12 19:07:44,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:44,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/colfamily11/b3664bfb2dea4f7ab27699e65bcb5eb3, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for cb90a60b65f36d3a89e67ce23d6e1791 in 30ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/857f7f7098ef081088fbf17dc14c7fab/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:44,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 857f7f7098ef081088fbf17dc14c7fab: 2023-07-12 19:07:44,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689188710937.857f7f7098ef081088fbf17dc14c7fab. 2023-07-12 19:07:44,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b33686861752ae5f44ef84731832666f, disabling compactions & flushes 2023-07-12 19:07:44,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:44,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:44,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. after waiting 0 ms 2023-07-12 19:07:44,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:44,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cb90a60b65f36d3a89e67ce23d6e1791/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:07:44,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cb90a60b65f36d3a89e67ce23d6e1791: 2023-07-12 19:07:44,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689188710937.cb90a60b65f36d3a89e67ce23d6e1791. 2023-07-12 19:07:44,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 673c9299883e0a0c447ecfa6b4e5e829, disabling compactions & flushes 2023-07-12 19:07:44,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b33686861752ae5f44ef84731832666f/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:44,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:44,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. after waiting 0 ms 2023-07-12 19:07:44,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:44,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:44,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b33686861752ae5f44ef84731832666f: 2023-07-12 19:07:44,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689188710937.b33686861752ae5f44ef84731832666f. 2023-07-12 19:07:44,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1d3260808db8616b1e8580567e7ef724, disabling compactions & flushes 2023-07-12 19:07:44,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:07:44,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:07:44,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. after waiting 0 ms 2023-07-12 19:07:44,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:07:44,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1d3260808db8616b1e8580567e7ef724 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/hbase/namespace/673c9299883e0a0c447ecfa6b4e5e829/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=5 2023-07-12 19:07:44,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:44,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 673c9299883e0a0c447ecfa6b4e5e829: 2023-07-12 19:07:44,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689188710074.673c9299883e0a0c447ecfa6b4e5e829. 2023-07-12 19:07:44,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 29241abdf5ae1e6c42878fb2f5b4824c, disabling compactions & flushes 2023-07-12 19:07:44,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:44,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:44,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. after waiting 0 ms 2023-07-12 19:07:44,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:44,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/29241abdf5ae1e6c42878fb2f5b4824c/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:44,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 29241abdf5ae1e6c42878fb2f5b4824c: 2023-07-12 19:07:44,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689188710937.29241abdf5ae1e6c42878fb2f5b4824c. 2023-07-12 19:07:44,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3932389baa9a41fc2c9f3bd588489325, disabling compactions & flushes 2023-07-12 19:07:44,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:07:44,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:07:44,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. after waiting 0 ms 2023-07-12 19:07:44,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:07:44,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 3932389baa9a41fc2c9f3bd588489325 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/.tmp/colfamily11/be4df220a57041199fe06534933092e7 2023-07-12 19:07:44,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/.tmp/colfamily11/e7c452cafac547d386fc6ecf3c79933f 2023-07-12 19:07:44,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/.tmp/colfamily11/be4df220a57041199fe06534933092e7 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily11/be4df220a57041199fe06534933092e7 2023-07-12 19:07:44,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/.tmp/colfamily11/e7c452cafac547d386fc6ecf3c79933f as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily11/e7c452cafac547d386fc6ecf3c79933f 2023-07-12 19:07:44,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/colfamily11/be4df220a57041199fe06534933092e7, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 1d3260808db8616b1e8580567e7ef724 in 40ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1d3260808db8616b1e8580567e7ef724/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:07:44,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1d3260808db8616b1e8580567e7ef724: 2023-07-12 19:07:44,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689188710937.1d3260808db8616b1e8580567e7ef724. 2023-07-12 19:07:44,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/colfamily11/e7c452cafac547d386fc6ecf3c79933f, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e088ea3e439d4723be549ccd39a34867, disabling compactions & flushes 2023-07-12 19:07:44,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:44,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:44,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. after waiting 0 ms 2023-07-12 19:07:44,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:44,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 3932389baa9a41fc2c9f3bd588489325 in 38ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e088ea3e439d4723be549ccd39a34867/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3932389baa9a41fc2c9f3bd588489325/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:44,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e088ea3e439d4723be549ccd39a34867: 2023-07-12 19:07:44,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689188710937.e088ea3e439d4723be549ccd39a34867. 2023-07-12 19:07:44,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:07:44,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3932389baa9a41fc2c9f3bd588489325: 2023-07-12 19:07:44,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a5ff2fcd2829ecc44f00cc2c00bb23ef, disabling compactions & flushes 2023-07-12 19:07:44,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:07:44,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689188710937.3932389baa9a41fc2c9f3bd588489325. 2023-07-12 19:07:44,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:07:44,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. after waiting 0 ms 2023-07-12 19:07:44,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:07:44,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e07929b49eb60c0014549c0b944194b1, disabling compactions & flushes 2023-07-12 19:07:44,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:07:44,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:07:44,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. after waiting 0 ms 2023-07-12 19:07:44,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:07:44,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing a5ff2fcd2829ecc44f00cc2c00bb23ef 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e07929b49eb60c0014549c0b944194b1 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/.tmp/colfamily11/4d57f468c7de48789f5a8812d5ff3bbe 2023-07-12 19:07:44,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/.tmp/colfamily11/48178868e92743419b2116797cc30cd6 2023-07-12 19:07:44,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/.tmp/colfamily11/4d57f468c7de48789f5a8812d5ff3bbe as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily11/4d57f468c7de48789f5a8812d5ff3bbe 2023-07-12 19:07:44,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/.tmp/colfamily11/48178868e92743419b2116797cc30cd6 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily11/48178868e92743419b2116797cc30cd6 2023-07-12 19:07:44,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/colfamily11/4d57f468c7de48789f5a8812d5ff3bbe, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/colfamily11/48178868e92743419b2116797cc30cd6, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a5ff2fcd2829ecc44f00cc2c00bb23ef in 30ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for e07929b49eb60c0014549c0b944194b1 in 30ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e07929b49eb60c0014549c0b944194b1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a5ff2fcd2829ecc44f00cc2c00bb23ef/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:07:44,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e07929b49eb60c0014549c0b944194b1: 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a5ff2fcd2829ecc44f00cc2c00bb23ef: 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689188710937.e07929b49eb60c0014549c0b944194b1. 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689188710937.a5ff2fcd2829ecc44f00cc2c00bb23ef. 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ecd2244642d3eaca1773ab751ae2cf01, disabling compactions & flushes 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f0c0cdd1d4e3b41a353e9f46f7be136f, disabling compactions & flushes 2023-07-12 19:07:44,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:07:44,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. after waiting 0 ms 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. after waiting 0 ms 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:07:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:44,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing ecd2244642d3eaca1773ab751ae2cf01 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f0c0cdd1d4e3b41a353e9f46f7be136f/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:44,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f0c0cdd1d4e3b41a353e9f46f7be136f: 2023-07-12 19:07:44,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689188710937.f0c0cdd1d4e3b41a353e9f46f7be136f. 2023-07-12 19:07:44,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 40193bfd281f2b2f7b454fbd94bd1f72, disabling compactions & flushes 2023-07-12 19:07:44,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:07:44,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:07:44,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. after waiting 0 ms 2023-07-12 19:07:44,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:07:44,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 40193bfd281f2b2f7b454fbd94bd1f72 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/.tmp/colfamily11/f68beb9ab5cf423ebb39cd70c4dedff3 2023-07-12 19:07:44,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/.tmp/colfamily11/2cf483a7997e4b29a5b958218bbb5be2 2023-07-12 19:07:44,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/.tmp/colfamily11/f68beb9ab5cf423ebb39cd70c4dedff3 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily11/f68beb9ab5cf423ebb39cd70c4dedff3 2023-07-12 19:07:44,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/.tmp/colfamily11/2cf483a7997e4b29a5b958218bbb5be2 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily11/2cf483a7997e4b29a5b958218bbb5be2 2023-07-12 19:07:44,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/colfamily11/f68beb9ab5cf423ebb39cd70c4dedff3, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ecd2244642d3eaca1773ab751ae2cf01 in 30ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecd2244642d3eaca1773ab751ae2cf01/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:07:44,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ecd2244642d3eaca1773ab751ae2cf01: 2023-07-12 19:07:44,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689188710937.ecd2244642d3eaca1773ab751ae2cf01. 2023-07-12 19:07:44,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4a0484dfe1e175ac58ae3850727dd3da, disabling compactions & flushes 2023-07-12 19:07:44,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:07:44,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:07:44,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. after waiting 0 ms 2023-07-12 19:07:44,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:07:44,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 4a0484dfe1e175ac58ae3850727dd3da 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/colfamily11/2cf483a7997e4b29a5b958218bbb5be2, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 40193bfd281f2b2f7b454fbd94bd1f72 in 35ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/40193bfd281f2b2f7b454fbd94bd1f72/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:07:44,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 40193bfd281f2b2f7b454fbd94bd1f72: 2023-07-12 19:07:44,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689188710937.40193bfd281f2b2f7b454fbd94bd1f72. 2023-07-12 19:07:44,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cba88346293ad1a9e4c0962a37c6a3a9, disabling compactions & flushes 2023-07-12 19:07:44,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:07:44,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:07:44,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. after waiting 0 ms 2023-07-12 19:07:44,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:07:44,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing cba88346293ad1a9e4c0962a37c6a3a9 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,299 DEBUG [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1504): Waiting on cba88346293ad1a9e4c0962a37c6a3a9, d553d6a56ac1a02eae16d402efdad87b, eb958e18b8a10f8d7d64dd6db676c171 2023-07-12 19:07:44,299 DEBUG [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1504): Waiting on 4a0484dfe1e175ac58ae3850727dd3da, ce7575edbb1d7e25bd4ed4b3e5bec644 2023-07-12 19:07:44,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/.tmp/colfamily11/5bfcd0909fff41aab85875c47532b889 2023-07-12 19:07:44,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/.tmp/colfamily11/4859642c52b84b498d448d0948a7b260 2023-07-12 19:07:44,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/.tmp/colfamily11/5bfcd0909fff41aab85875c47532b889 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily11/5bfcd0909fff41aab85875c47532b889 2023-07-12 19:07:44,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/.tmp/colfamily11/4859642c52b84b498d448d0948a7b260 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily11/4859642c52b84b498d448d0948a7b260 2023-07-12 19:07:44,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/colfamily11/5bfcd0909fff41aab85875c47532b889, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 4a0484dfe1e175ac58ae3850727dd3da in 36ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/colfamily11/4859642c52b84b498d448d0948a7b260, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for cba88346293ad1a9e4c0962a37c6a3a9 in 30ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4a0484dfe1e175ac58ae3850727dd3da/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:07:44,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4a0484dfe1e175ac58ae3850727dd3da: 2023-07-12 19:07:44,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689188710937.4a0484dfe1e175ac58ae3850727dd3da. 2023-07-12 19:07:44,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ce7575edbb1d7e25bd4ed4b3e5bec644, disabling compactions & flushes 2023-07-12 19:07:44,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:44,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:44,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. after waiting 0 ms 2023-07-12 19:07:44,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:44,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cba88346293ad1a9e4c0962a37c6a3a9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:07:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cba88346293ad1a9e4c0962a37c6a3a9: 2023-07-12 19:07:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689188710937.cba88346293ad1a9e4c0962a37c6a3a9. 2023-07-12 19:07:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing eb958e18b8a10f8d7d64dd6db676c171, disabling compactions & flushes 2023-07-12 19:07:44,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. after waiting 0 ms 2023-07-12 19:07:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:44,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ce7575edbb1d7e25bd4ed4b3e5bec644/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:44,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ce7575edbb1d7e25bd4ed4b3e5bec644: 2023-07-12 19:07:44,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689188710937.ce7575edbb1d7e25bd4ed4b3e5bec644. 2023-07-12 19:07:44,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/eb958e18b8a10f8d7d64dd6db676c171/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 19:07:44,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:44,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for eb958e18b8a10f8d7d64dd6db676c171: 2023-07-12 19:07:44,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689188710937.eb958e18b8a10f8d7d64dd6db676c171. 2023-07-12 19:07:44,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d553d6a56ac1a02eae16d402efdad87b, disabling compactions & flushes 2023-07-12 19:07:44,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:07:44,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:07:44,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. after waiting 0 ms 2023-07-12 19:07:44,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:07:44,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing d553d6a56ac1a02eae16d402efdad87b 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 19:07:44,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/.tmp/colfamily11/ac5d8fbf25244edcbea246e9a9fe1959 2023-07-12 19:07:44,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/.tmp/colfamily11/ac5d8fbf25244edcbea246e9a9fe1959 as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily11/ac5d8fbf25244edcbea246e9a9fe1959 2023-07-12 19:07:44,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/colfamily11/ac5d8fbf25244edcbea246e9a9fe1959, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 19:07:44,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for d553d6a56ac1a02eae16d402efdad87b in 25ms, sequenceid=5, compaction requested=false 2023-07-12 19:07:44,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d553d6a56ac1a02eae16d402efdad87b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 19:07:44,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:07:44,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d553d6a56ac1a02eae16d402efdad87b: 2023-07-12 19:07:44,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689188710937.d553d6a56ac1a02eae16d402efdad87b. 2023-07-12 19:07:44,461 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 19:07:44,461 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 19:07:44,499 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44977,1689188708156; all regions closed. 2023-07-12 19:07:44,499 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36833,1689188708236; all regions closed. 2023-07-12 19:07:44,509 DEBUG [RS:2;jenkins-hbase20:36833] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs 2023-07-12 19:07:44,509 DEBUG [RS:0;jenkins-hbase20:44977] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs 2023-07-12 19:07:44,509 INFO [RS:2;jenkins-hbase20:36833] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36833%2C1689188708236.meta:.meta(num 1689188859544) 2023-07-12 19:07:44,509 INFO [RS:0;jenkins-hbase20:44977] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44977%2C1689188708156:(num 1689188709627) 2023-07-12 19:07:44,509 DEBUG [RS:0;jenkins-hbase20:44977] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:07:44,509 INFO [RS:0;jenkins-hbase20:44977] regionserver.LeaseManager(133): Closed leases 2023-07-12 19:07:44,510 INFO [RS:0;jenkins-hbase20:44977] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 19:07:44,510 INFO [RS:0;jenkins-hbase20:44977] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 19:07:44,510 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 19:07:44,510 INFO [RS:0;jenkins-hbase20:44977] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 19:07:44,510 INFO [RS:0;jenkins-hbase20:44977] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 19:07:44,511 INFO [RS:0;jenkins-hbase20:44977] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44977 2023-07-12 19:07:44,515 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:44,515 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:07:44,515 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44977,1689188708156 2023-07-12 19:07:44,515 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:07:44,515 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:07:44,516 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44977,1689188708156] 2023-07-12 19:07:44,516 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44977,1689188708156; numProcessing=1 2023-07-12 19:07:44,517 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44977,1689188708156 already deleted, retry=false 2023-07-12 19:07:44,517 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44977,1689188708156 expired; onlineServers=1 2023-07-12 19:07:44,520 DEBUG [RS:2;jenkins-hbase20:36833] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/oldWALs 2023-07-12 19:07:44,520 INFO [RS:2;jenkins-hbase20:36833] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36833%2C1689188708236:(num 1689188709627) 2023-07-12 19:07:44,520 DEBUG [RS:2;jenkins-hbase20:36833] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:07:44,520 INFO [RS:2;jenkins-hbase20:36833] regionserver.LeaseManager(133): Closed leases 2023-07-12 19:07:44,520 INFO [RS:2;jenkins-hbase20:36833] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 19:07:44,521 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 19:07:44,521 INFO [RS:2;jenkins-hbase20:36833] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36833 2023-07-12 19:07:44,524 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 19:07:44,524 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,36833,1689188708236 2023-07-12 19:07:44,525 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,36833,1689188708236] 2023-07-12 19:07:44,525 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,36833,1689188708236; numProcessing=2 2023-07-12 19:07:44,525 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,36833,1689188708236 already deleted, retry=false 2023-07-12 19:07:44,525 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,36833,1689188708236 expired; onlineServers=0 2023-07-12 19:07:44,525 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41319,1689188707186' ***** 2023-07-12 19:07:44,526 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 19:07:44,526 DEBUG [M:0;jenkins-hbase20:41319] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a0152aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 19:07:44,526 INFO [M:0;jenkins-hbase20:41319] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,41319,1689188707186 2023-07-12 19:07:44,526 INFO [M:0;jenkins-hbase20:41319] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,41319,1689188707186; all regions closed. 2023-07-12 19:07:44,526 DEBUG [M:0;jenkins-hbase20:41319] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 19:07:44,526 DEBUG [M:0;jenkins-hbase20:41319] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 19:07:44,527 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 19:07:44,527 DEBUG [M:0;jenkins-hbase20:41319] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 19:07:44,527 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689188709268] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689188709268,5,FailOnTimeoutGroup] 2023-07-12 19:07:44,527 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689188709266] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689188709266,5,FailOnTimeoutGroup] 2023-07-12 19:07:44,528 INFO [M:0;jenkins-hbase20:41319] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 19:07:44,528 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 19:07:44,528 INFO [M:0;jenkins-hbase20:41319] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 19:07:44,528 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 19:07:44,528 INFO [M:0;jenkins-hbase20:41319] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 19:07:44,528 DEBUG [M:0;jenkins-hbase20:41319] master.HMaster(1512): Stopping service threads 2023-07-12 19:07:44,528 INFO [M:0;jenkins-hbase20:41319] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 19:07:44,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 19:07:44,529 ERROR [M:0;jenkins-hbase20:41319] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 19:07:44,529 INFO [M:0;jenkins-hbase20:41319] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 19:07:44,529 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 19:07:44,529 DEBUG [M:0;jenkins-hbase20:41319] zookeeper.ZKUtil(398): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 19:07:44,529 WARN [M:0;jenkins-hbase20:41319] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 19:07:44,529 INFO [M:0;jenkins-hbase20:41319] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 19:07:44,530 INFO [M:0;jenkins-hbase20:41319] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 19:07:44,530 DEBUG [M:0;jenkins-hbase20:41319] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 19:07:44,530 INFO [M:0;jenkins-hbase20:41319] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:07:44,530 DEBUG [M:0;jenkins-hbase20:41319] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:07:44,530 DEBUG [M:0;jenkins-hbase20:41319] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 19:07:44,530 DEBUG [M:0;jenkins-hbase20:41319] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:07:44,530 INFO [M:0;jenkins-hbase20:41319] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=342.63 KB heapSize=399.92 KB 2023-07-12 19:07:44,546 INFO [M:0;jenkins-hbase20:41319] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=342.63 KB at sequenceid=609 (bloomFilter=true), to=hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7ff2065d3b094b2eb19986bf53ffac5e 2023-07-12 19:07:44,551 DEBUG [M:0;jenkins-hbase20:41319] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7ff2065d3b094b2eb19986bf53ffac5e as hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7ff2065d3b094b2eb19986bf53ffac5e 2023-07-12 19:07:44,556 INFO [M:0;jenkins-hbase20:41319] regionserver.HStore(1080): Added hdfs://localhost.localdomain:39619/user/jenkins/test-data/4c27c493-20ed-2950-55f5-9b9f6d8c70bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7ff2065d3b094b2eb19986bf53ffac5e, entries=88, sequenceid=609, filesize=14.3 K 2023-07-12 19:07:44,557 INFO [M:0;jenkins-hbase20:41319] regionserver.HRegion(2948): Finished flush of dataSize ~342.63 KB/350855, heapSize ~399.91 KB/409504, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=609, compaction requested=false 2023-07-12 19:07:44,558 INFO [M:0;jenkins-hbase20:41319] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 19:07:44,558 DEBUG [M:0;jenkins-hbase20:41319] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 19:07:44,561 INFO [M:0;jenkins-hbase20:41319] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 19:07:44,562 INFO [M:0;jenkins-hbase20:41319] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41319 2023-07-12 19:07:44,562 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 19:07:44,564 DEBUG [M:0;jenkins-hbase20:41319] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,41319,1689188707186 already deleted, retry=false 2023-07-12 19:07:44,616 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:07:44,616 INFO [RS:0;jenkins-hbase20:44977] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44977,1689188708156; zookeeper connection closed. 2023-07-12 19:07:44,617 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:44977-0x1008292a4e80001, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:07:44,619 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@19b93d46] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@19b93d46 2023-07-12 19:07:44,717 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:07:44,717 INFO [M:0;jenkins-hbase20:41319] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41319,1689188707186; zookeeper connection closed. 2023-07-12 19:07:44,717 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): master:41319-0x1008292a4e80000, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:07:44,817 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:07:44,817 DEBUG [Listener at localhost.localdomain/45243-EventThread] zookeeper.ZKWatcher(600): regionserver:36833-0x1008292a4e80003, quorum=127.0.0.1:62537, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 19:07:44,817 INFO [RS:2;jenkins-hbase20:36833] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36833,1689188708236; zookeeper connection closed. 2023-07-12 19:07:44,818 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f0cff09] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f0cff09 2023-07-12 19:07:44,818 INFO [Listener at localhost.localdomain/45243] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 19:07:44,819 WARN [Listener at localhost.localdomain/45243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 19:07:44,822 INFO [Listener at localhost.localdomain/45243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 19:07:44,930 WARN [BP-1090920917-148.251.75.209-1689188704330 heartbeating to localhost.localdomain/127.0.0.1:39619] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 19:07:44,931 WARN [BP-1090920917-148.251.75.209-1689188704330 heartbeating to localhost.localdomain/127.0.0.1:39619] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1090920917-148.251.75.209-1689188704330 (Datanode Uuid 886114ee-318e-4fdc-8da8-714328a2121c) service to localhost.localdomain/127.0.0.1:39619 2023-07-12 19:07:44,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/dfs/data/data5/current/BP-1090920917-148.251.75.209-1689188704330] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 19:07:44,934 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/dfs/data/data6/current/BP-1090920917-148.251.75.209-1689188704330] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 19:07:44,934 WARN [Listener at localhost.localdomain/45243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 19:07:44,937 INFO [Listener at localhost.localdomain/45243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 19:07:45,041 WARN [BP-1090920917-148.251.75.209-1689188704330 heartbeating to localhost.localdomain/127.0.0.1:39619] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 19:07:45,044 WARN [BP-1090920917-148.251.75.209-1689188704330 heartbeating to localhost.localdomain/127.0.0.1:39619] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1090920917-148.251.75.209-1689188704330 (Datanode Uuid 0984da87-f112-4262-b2e6-2dfc9dba7752) service to localhost.localdomain/127.0.0.1:39619 2023-07-12 19:07:45,047 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/dfs/data/data3/current/BP-1090920917-148.251.75.209-1689188704330] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 19:07:45,047 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/dfs/data/data4/current/BP-1090920917-148.251.75.209-1689188704330] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 19:07:45,047 WARN [Listener at localhost.localdomain/45243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 19:07:45,050 INFO [Listener at localhost.localdomain/45243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 19:07:45,105 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 19:07:45,134 WARN [BP-1090920917-148.251.75.209-1689188704330 heartbeating to localhost.localdomain/127.0.0.1:39619] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1090920917-148.251.75.209-1689188704330 (Datanode Uuid 91a64be1-94ca-469a-9775-b270878670ac) service to localhost.localdomain/127.0.0.1:39619 2023-07-12 19:07:45,135 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/dfs/data/data1/current/BP-1090920917-148.251.75.209-1689188704330] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 19:07:45,135 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/11eeb741-226b-109f-064e-1f9e81310db0/cluster_059ba79c-4201-0371-cdff-2ac84045c9e1/dfs/data/data2/current/BP-1090920917-148.251.75.209-1689188704330] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 19:07:45,182 INFO [Listener at localhost.localdomain/45243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 19:07:45,313 INFO [Listener at localhost.localdomain/45243] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 19:07:45,390 INFO [Listener at localhost.localdomain/45243] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 19:07:45,402 INFO [Listener at localhost.localdomain/45243] hbase.ResourceChecker(175): after: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=77 (was 9) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (397511039) connection to localhost.localdomain/127.0.0.1:39619 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost.localdomain:39619 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (397511039) connection to localhost.localdomain/127.0.0.1:39619 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Abort regionserver monitor java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/45243 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (397511039) connection to localhost.localdomain/127.0.0.1:39619 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_META-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase20:35281Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1cfc051 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.Chore.1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.logRoller java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:179) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:39619 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (397511039) connection to localhost.localdomain/127.0.0.1:39619 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:39619 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=542 (was 256) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 284), ProcessCount=169 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=5682 (was 6526)