2023-07-12 01:04:46,360 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta timeout: 13 mins 2023-07-12 01:04:46,403 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=9, OpenFileDescriptor=256, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=5243 2023-07-12 01:04:46,634 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6 2023-07-12 01:04:46,637 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 01:04:46,637 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670, deleteOnExit=true 2023-07-12 01:04:46,638 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 01:04:46,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/test.cache.data in system properties and HBase conf 2023-07-12 01:04:46,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 01:04:46,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/hadoop.log.dir in system properties and HBase conf 2023-07-12 01:04:46,641 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 01:04:46,641 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 01:04:46,641 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 01:04:46,731 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 01:04:47,048 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 01:04:47,051 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 01:04:47,051 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 01:04:47,051 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 01:04:47,052 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 01:04:47,052 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 01:04:47,052 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 01:04:47,052 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 01:04:47,053 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 01:04:47,053 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 01:04:47,053 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/nfs.dump.dir in system properties and HBase conf 2023-07-12 01:04:47,054 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/java.io.tmpdir in system properties and HBase conf 2023-07-12 01:04:47,054 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 01:04:47,054 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 01:04:47,054 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 01:04:47,481 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 01:04:47,484 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 01:04:47,699 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 01:04:47,845 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 01:04:47,858 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 01:04:47,893 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 01:04:47,920 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/java.io.tmpdir/Jetty_localhost_localdomain_35863_hdfs____.146gur/webapp 2023-07-12 01:04:48,048 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:35863 2023-07-12 01:04:48,056 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 01:04:48,056 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 01:04:48,375 WARN [Listener at localhost.localdomain/44213] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 01:04:48,466 WARN [Listener at localhost.localdomain/44213] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 01:04:48,482 WARN [Listener at localhost.localdomain/44213] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 01:04:48,490 INFO [Listener at localhost.localdomain/44213] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 01:04:48,496 INFO [Listener at localhost.localdomain/44213] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/java.io.tmpdir/Jetty_localhost_39619_datanode____cbuvtr/webapp 2023-07-12 01:04:48,576 INFO [Listener at localhost.localdomain/44213] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39619 2023-07-12 01:04:48,841 WARN [Listener at localhost.localdomain/41969] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 01:04:48,851 WARN [Listener at localhost.localdomain/41969] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 01:04:48,853 WARN [Listener at localhost.localdomain/41969] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 01:04:48,855 INFO [Listener at localhost.localdomain/41969] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 01:04:48,862 INFO [Listener at localhost.localdomain/41969] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/java.io.tmpdir/Jetty_localhost_34541_datanode____.roj414/webapp 2023-07-12 01:04:48,937 INFO [Listener at localhost.localdomain/41969] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34541 2023-07-12 01:04:48,946 WARN [Listener at localhost.localdomain/39067] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 01:04:48,958 WARN [Listener at localhost.localdomain/39067] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 01:04:48,961 WARN [Listener at localhost.localdomain/39067] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 01:04:48,963 INFO [Listener at localhost.localdomain/39067] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 01:04:48,972 INFO [Listener at localhost.localdomain/39067] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/java.io.tmpdir/Jetty_localhost_43903_datanode____.fg83gc/webapp 2023-07-12 01:04:49,063 INFO [Listener at localhost.localdomain/39067] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43903 2023-07-12 01:04:49,073 WARN [Listener at localhost.localdomain/45615] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 01:04:49,262 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x120335561a813a44: Processing first storage report for DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4 from datanode 6a010157-a4c8-4338-8758-6ebbb22e1e02 2023-07-12 01:04:49,263 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x120335561a813a44: from storage DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4 node DatanodeRegistration(127.0.0.1:35619, datanodeUuid=6a010157-a4c8-4338-8758-6ebbb22e1e02, infoPort=37631, infoSecurePort=0, ipcPort=45615, storageInfo=lv=-57;cid=testClusterID;nsid=2116300465;c=1689123887541), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 01:04:49,263 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x50fcefc2366dfdbf: Processing first storage report for DS-133d2a2e-c997-49a4-afb4-bc7461865601 from datanode 6144f188-05d1-41f1-9f40-5792c097cdfe 2023-07-12 01:04:49,263 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x50fcefc2366dfdbf: from storage DS-133d2a2e-c997-49a4-afb4-bc7461865601 node DatanodeRegistration(127.0.0.1:46027, datanodeUuid=6144f188-05d1-41f1-9f40-5792c097cdfe, infoPort=42533, infoSecurePort=0, ipcPort=39067, storageInfo=lv=-57;cid=testClusterID;nsid=2116300465;c=1689123887541), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 01:04:49,264 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3b876273955a11: Processing first storage report for DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73 from datanode 5f1e2cb2-a138-426b-afe9-8d21544770f9 2023-07-12 01:04:49,264 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3b876273955a11: from storage DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73 node DatanodeRegistration(127.0.0.1:33375, datanodeUuid=5f1e2cb2-a138-426b-afe9-8d21544770f9, infoPort=35621, infoSecurePort=0, ipcPort=41969, storageInfo=lv=-57;cid=testClusterID;nsid=2116300465;c=1689123887541), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 01:04:49,264 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x120335561a813a44: Processing first storage report for DS-a197ceb3-fb6e-41fb-a2f3-dc20d3bc544a from datanode 6a010157-a4c8-4338-8758-6ebbb22e1e02 2023-07-12 01:04:49,264 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x120335561a813a44: from storage DS-a197ceb3-fb6e-41fb-a2f3-dc20d3bc544a node DatanodeRegistration(127.0.0.1:35619, datanodeUuid=6a010157-a4c8-4338-8758-6ebbb22e1e02, infoPort=37631, infoSecurePort=0, ipcPort=45615, storageInfo=lv=-57;cid=testClusterID;nsid=2116300465;c=1689123887541), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 01:04:49,264 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x50fcefc2366dfdbf: Processing first storage report for DS-862cbc64-d54e-4674-9f27-736362daefd7 from datanode 6144f188-05d1-41f1-9f40-5792c097cdfe 2023-07-12 01:04:49,264 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x50fcefc2366dfdbf: from storage DS-862cbc64-d54e-4674-9f27-736362daefd7 node DatanodeRegistration(127.0.0.1:46027, datanodeUuid=6144f188-05d1-41f1-9f40-5792c097cdfe, infoPort=42533, infoSecurePort=0, ipcPort=39067, storageInfo=lv=-57;cid=testClusterID;nsid=2116300465;c=1689123887541), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 01:04:49,264 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3b876273955a11: Processing first storage report for DS-b0f9075e-510c-45a0-9f59-fc330a854074 from datanode 5f1e2cb2-a138-426b-afe9-8d21544770f9 2023-07-12 01:04:49,265 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3b876273955a11: from storage DS-b0f9075e-510c-45a0-9f59-fc330a854074 node DatanodeRegistration(127.0.0.1:33375, datanodeUuid=5f1e2cb2-a138-426b-afe9-8d21544770f9, infoPort=35621, infoSecurePort=0, ipcPort=41969, storageInfo=lv=-57;cid=testClusterID;nsid=2116300465;c=1689123887541), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 01:04:49,420 DEBUG [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6 2023-07-12 01:04:49,478 INFO [Listener at localhost.localdomain/45615] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/zookeeper_0, clientPort=57181, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 01:04:49,490 INFO [Listener at localhost.localdomain/45615] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57181 2023-07-12 01:04:49,501 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:49,503 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:50,119 INFO [Listener at localhost.localdomain/45615] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67 with version=8 2023-07-12 01:04:50,120 INFO [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/hbase-staging 2023-07-12 01:04:50,380 INFO [Listener at localhost.localdomain/45615] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 01:04:50,747 INFO [Listener at localhost.localdomain/45615] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 01:04:50,772 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:50,772 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:50,772 INFO [Listener at localhost.localdomain/45615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 01:04:50,772 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:50,773 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 01:04:50,884 INFO [Listener at localhost.localdomain/45615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 01:04:50,943 DEBUG [Listener at localhost.localdomain/45615] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 01:04:51,020 INFO [Listener at localhost.localdomain/45615] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37493 2023-07-12 01:04:51,030 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,033 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,051 INFO [Listener at localhost.localdomain/45615] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37493 connecting to ZooKeeper ensemble=127.0.0.1:57181 2023-07-12 01:04:51,080 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:374930x0, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 01:04:51,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37493-0x1007eb59db80000 connected 2023-07-12 01:04:51,110 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 01:04:51,111 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 01:04:51,116 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 01:04:51,125 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37493 2023-07-12 01:04:51,125 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37493 2023-07-12 01:04:51,126 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37493 2023-07-12 01:04:51,126 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37493 2023-07-12 01:04:51,127 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37493 2023-07-12 01:04:51,133 INFO [Listener at localhost.localdomain/45615] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67, hbase.cluster.distributed=false 2023-07-12 01:04:51,189 INFO [Listener at localhost.localdomain/45615] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 01:04:51,189 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,189 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,190 INFO [Listener at localhost.localdomain/45615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 01:04:51,190 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,190 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 01:04:51,194 INFO [Listener at localhost.localdomain/45615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 01:04:51,197 INFO [Listener at localhost.localdomain/45615] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39185 2023-07-12 01:04:51,198 INFO [Listener at localhost.localdomain/45615] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 01:04:51,203 DEBUG [Listener at localhost.localdomain/45615] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 01:04:51,204 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,206 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,207 INFO [Listener at localhost.localdomain/45615] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39185 connecting to ZooKeeper ensemble=127.0.0.1:57181 2023-07-12 01:04:51,211 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:391850x0, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 01:04:51,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39185-0x1007eb59db80001 connected 2023-07-12 01:04:51,213 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 01:04:51,214 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 01:04:51,215 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 01:04:51,215 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39185 2023-07-12 01:04:51,215 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39185 2023-07-12 01:04:51,216 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39185 2023-07-12 01:04:51,218 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39185 2023-07-12 01:04:51,219 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39185 2023-07-12 01:04:51,230 INFO [Listener at localhost.localdomain/45615] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 01:04:51,230 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,230 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,231 INFO [Listener at localhost.localdomain/45615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 01:04:51,231 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,231 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 01:04:51,232 INFO [Listener at localhost.localdomain/45615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 01:04:51,233 INFO [Listener at localhost.localdomain/45615] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44505 2023-07-12 01:04:51,233 INFO [Listener at localhost.localdomain/45615] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 01:04:51,234 DEBUG [Listener at localhost.localdomain/45615] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 01:04:51,235 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,237 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,240 INFO [Listener at localhost.localdomain/45615] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44505 connecting to ZooKeeper ensemble=127.0.0.1:57181 2023-07-12 01:04:51,243 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:445050x0, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 01:04:51,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44505-0x1007eb59db80002 connected 2023-07-12 01:04:51,245 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 01:04:51,246 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 01:04:51,246 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 01:04:51,248 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44505 2023-07-12 01:04:51,248 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44505 2023-07-12 01:04:51,248 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44505 2023-07-12 01:04:51,248 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44505 2023-07-12 01:04:51,249 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44505 2023-07-12 01:04:51,259 INFO [Listener at localhost.localdomain/45615] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 01:04:51,260 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,260 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,260 INFO [Listener at localhost.localdomain/45615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 01:04:51,260 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 01:04:51,260 INFO [Listener at localhost.localdomain/45615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 01:04:51,260 INFO [Listener at localhost.localdomain/45615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 01:04:51,262 INFO [Listener at localhost.localdomain/45615] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41693 2023-07-12 01:04:51,262 INFO [Listener at localhost.localdomain/45615] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 01:04:51,263 DEBUG [Listener at localhost.localdomain/45615] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 01:04:51,264 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,265 INFO [Listener at localhost.localdomain/45615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,267 INFO [Listener at localhost.localdomain/45615] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41693 connecting to ZooKeeper ensemble=127.0.0.1:57181 2023-07-12 01:04:51,272 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:416930x0, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 01:04:51,273 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:416930x0, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 01:04:51,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41693-0x1007eb59db80003 connected 2023-07-12 01:04:51,274 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 01:04:51,275 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ZKUtil(164): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 01:04:51,275 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41693 2023-07-12 01:04:51,276 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41693 2023-07-12 01:04:51,276 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41693 2023-07-12 01:04:51,276 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41693 2023-07-12 01:04:51,276 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41693 2023-07-12 01:04:51,278 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:51,288 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 01:04:51,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:51,305 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 01:04:51,305 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 01:04:51,305 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 01:04:51,305 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 01:04:51,305 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:51,306 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 01:04:51,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,37493,1689123890227 from backup master directory 2023-07-12 01:04:51,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 01:04:51,311 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:51,312 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 01:04:51,312 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 01:04:51,312 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:51,315 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 01:04:51,316 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 01:04:51,398 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/hbase.id with ID: aedc503a-7703-45fe-8918-627d364468cb 2023-07-12 01:04:51,447 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 01:04:51,461 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:51,537 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x59e7fd6a to 127.0.0.1:57181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 01:04:51,575 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c6ee9a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 01:04:51,597 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 01:04:51,598 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 01:04:51,613 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 01:04:51,613 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 01:04:51,615 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:04:51,618 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:04:51,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 01:04:51,649 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store-tmp 2023-07-12 01:04:51,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:51,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 01:04:51,690 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:04:51,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:04:51,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 01:04:51,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:04:51,690 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:04:51,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 01:04:51,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/WALs/jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:51,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37493%2C1689123890227, suffix=, logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/WALs/jenkins-hbase20.apache.org,37493,1689123890227, archiveDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/oldWALs, maxLogs=10 2023-07-12 01:04:51,764 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK] 2023-07-12 01:04:51,764 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK] 2023-07-12 01:04:51,764 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK] 2023-07-12 01:04:51,774 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:04:51,833 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/WALs/jenkins-hbase20.apache.org,37493,1689123890227/jenkins-hbase20.apache.org%2C37493%2C1689123890227.1689123891721 2023-07-12 01:04:51,834 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK], DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK], DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK]] 2023-07-12 01:04:51,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 01:04:51,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:51,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 01:04:51,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 01:04:51,891 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 01:04:51,897 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 01:04:51,918 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 01:04:51,928 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:51,933 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 01:04:51,935 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 01:04:51,953 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 01:04:51,958 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:51,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66097739, jitterRate=-0.015066936612129211}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 01:04:51,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 01:04:51,961 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 01:04:51,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:04:51,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:04:51,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:04:51,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 01:04:52,015 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 27 msec 2023-07-12 01:04:52,015 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 01:04:52,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 01:04:52,042 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 01:04:52,063 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 01:04:52,066 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 01:04:52,067 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 01:04:52,072 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 01:04:52,076 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 01:04:52,078 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:52,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 01:04:52,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 01:04:52,095 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 01:04:52,100 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 01:04:52,100 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 01:04:52,100 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:52,100 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 01:04:52,100 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 01:04:52,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,37493,1689123890227, sessionid=0x1007eb59db80000, setting cluster-up flag (Was=false) 2023-07-12 01:04:52,114 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:52,117 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 01:04:52,118 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:52,122 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:52,126 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 01:04:52,127 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:52,129 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.hbase-snapshot/.tmp 2023-07-12 01:04:52,180 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(951): ClusterId : aedc503a-7703-45fe-8918-627d364468cb 2023-07-12 01:04:52,180 INFO [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(951): ClusterId : aedc503a-7703-45fe-8918-627d364468cb 2023-07-12 01:04:52,180 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(951): ClusterId : aedc503a-7703-45fe-8918-627d364468cb 2023-07-12 01:04:52,186 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 01:04:52,186 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 01:04:52,186 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 01:04:52,192 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 01:04:52,192 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 01:04:52,192 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 01:04:52,192 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 01:04:52,192 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 01:04:52,192 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 01:04:52,199 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 01:04:52,200 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 01:04:52,201 DEBUG [RS:2;jenkins-hbase20:41693] zookeeper.ReadOnlyZKClient(139): Connect 0x2d6e30c1 to 127.0.0.1:57181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 01:04:52,201 DEBUG [RS:0;jenkins-hbase20:39185] zookeeper.ReadOnlyZKClient(139): Connect 0x7df1ebf7 to 127.0.0.1:57181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 01:04:52,202 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 01:04:52,206 DEBUG [RS:1;jenkins-hbase20:44505] zookeeper.ReadOnlyZKClient(139): Connect 0x49e249f4 to 127.0.0.1:57181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 01:04:52,219 DEBUG [RS:2;jenkins-hbase20:41693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23a9cb1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 01:04:52,219 DEBUG [RS:0;jenkins-hbase20:39185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73361a39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 01:04:52,219 DEBUG [RS:2;jenkins-hbase20:41693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27965bb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 01:04:52,219 DEBUG [RS:0;jenkins-hbase20:39185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77098087, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 01:04:52,223 DEBUG [RS:1;jenkins-hbase20:44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4725beb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 01:04:52,223 DEBUG [RS:1;jenkins-hbase20:44505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@431a2284, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 01:04:52,243 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:39185 2023-07-12 01:04:52,243 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:44505 2023-07-12 01:04:52,246 DEBUG [RS:2;jenkins-hbase20:41693] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:41693 2023-07-12 01:04:52,248 INFO [RS:1;jenkins-hbase20:44505] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 01:04:52,248 INFO [RS:2;jenkins-hbase20:41693] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 01:04:52,249 INFO [RS:2;jenkins-hbase20:41693] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 01:04:52,248 INFO [RS:0;jenkins-hbase20:39185] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 01:04:52,249 DEBUG [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 01:04:52,249 INFO [RS:1;jenkins-hbase20:44505] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 01:04:52,249 INFO [RS:0;jenkins-hbase20:39185] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 01:04:52,249 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 01:04:52,249 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 01:04:52,251 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37493,1689123890227 with isa=jenkins-hbase20.apache.org/148.251.75.209:44505, startcode=1689123891229 2023-07-12 01:04:52,251 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37493,1689123890227 with isa=jenkins-hbase20.apache.org/148.251.75.209:39185, startcode=1689123891188 2023-07-12 01:04:52,251 INFO [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37493,1689123890227 with isa=jenkins-hbase20.apache.org/148.251.75.209:41693, startcode=1689123891259 2023-07-12 01:04:52,264 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 01:04:52,269 DEBUG [RS:0;jenkins-hbase20:39185] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 01:04:52,269 DEBUG [RS:2;jenkins-hbase20:41693] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 01:04:52,269 DEBUG [RS:1;jenkins-hbase20:44505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 01:04:52,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 01:04:52,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 01:04:52,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 01:04:52,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 01:04:52,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 01:04:52,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 01:04:52,275 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,275 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689123922275 2023-07-12 01:04:52,278 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 01:04:52,283 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 01:04:52,283 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 01:04:52,289 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 01:04:52,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 01:04:52,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 01:04:52,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 01:04:52,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 01:04:52,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 01:04:52,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 01:04:52,310 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 01:04:52,311 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 01:04:52,318 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 01:04:52,318 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 01:04:52,321 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689123892320,5,FailOnTimeoutGroup] 2023-07-12 01:04:52,322 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689123892321,5,FailOnTimeoutGroup] 2023-07-12 01:04:52,322 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,322 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 01:04:52,323 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,323 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,338 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46913, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 01:04:52,338 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54409, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 01:04:52,338 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57499, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 01:04:52,360 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 01:04:52,361 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 01:04:52,361 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67 2023-07-12 01:04:52,362 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37493] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,380 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37493] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,382 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37493] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,389 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67 2023-07-12 01:04:52,389 DEBUG [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67 2023-07-12 01:04:52,389 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67 2023-07-12 01:04:52,389 DEBUG [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44213 2023-07-12 01:04:52,389 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44213 2023-07-12 01:04:52,390 DEBUG [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 01:04:52,389 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44213 2023-07-12 01:04:52,390 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 01:04:52,390 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 01:04:52,391 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:52,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 01:04:52,395 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:04:52,397 DEBUG [RS:2;jenkins-hbase20:41693] zookeeper.ZKUtil(162): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,397 DEBUG [RS:1;jenkins-hbase20:44505] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,397 WARN [RS:2;jenkins-hbase20:41693] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 01:04:52,397 WARN [RS:1;jenkins-hbase20:44505] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 01:04:52,397 INFO [RS:2;jenkins-hbase20:41693] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 01:04:52,398 INFO [RS:1;jenkins-hbase20:44505] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 01:04:52,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info 2023-07-12 01:04:52,398 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,398 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41693,1689123891259] 2023-07-12 01:04:52,398 DEBUG [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,398 DEBUG [RS:0;jenkins-hbase20:39185] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,398 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44505,1689123891229] 2023-07-12 01:04:52,398 WARN [RS:0;jenkins-hbase20:39185] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 01:04:52,398 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,39185,1689123891188] 2023-07-12 01:04:52,398 INFO [RS:0;jenkins-hbase20:39185] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 01:04:52,399 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,401 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 01:04:52,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:52,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 01:04:52,409 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/rep_barrier 2023-07-12 01:04:52,410 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 01:04:52,411 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:52,412 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 01:04:52,412 DEBUG [RS:1;jenkins-hbase20:44505] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,413 DEBUG [RS:2;jenkins-hbase20:41693] zookeeper.ZKUtil(162): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,413 DEBUG [RS:0;jenkins-hbase20:39185] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,413 DEBUG [RS:1;jenkins-hbase20:44505] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,413 DEBUG [RS:0;jenkins-hbase20:39185] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,413 DEBUG [RS:2;jenkins-hbase20:41693] zookeeper.ZKUtil(162): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,414 DEBUG [RS:1;jenkins-hbase20:44505] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,414 DEBUG [RS:2;jenkins-hbase20:41693] zookeeper.ZKUtil(162): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,414 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/table 2023-07-12 01:04:52,415 DEBUG [RS:0;jenkins-hbase20:39185] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,415 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 01:04:52,416 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:52,418 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740 2023-07-12 01:04:52,420 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740 2023-07-12 01:04:52,425 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:52,426 DEBUG [RS:2;jenkins-hbase20:41693] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 01:04:52,427 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 01:04:52,426 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 01:04:52,429 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 01:04:52,437 INFO [RS:1;jenkins-hbase20:44505] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 01:04:52,437 INFO [RS:0;jenkins-hbase20:39185] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 01:04:52,437 INFO [RS:2;jenkins-hbase20:41693] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 01:04:52,444 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:52,445 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66637145, jitterRate=-0.0070291608572006226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:52,445 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 01:04:52,445 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 01:04:52,445 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 01:04:52,445 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 01:04:52,446 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 01:04:52,446 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 01:04:52,447 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 01:04:52,447 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 01:04:52,463 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 01:04:52,463 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 01:04:52,468 INFO [RS:0;jenkins-hbase20:39185] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 01:04:52,468 INFO [RS:1;jenkins-hbase20:44505] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 01:04:52,468 INFO [RS:2;jenkins-hbase20:41693] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 01:04:52,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 01:04:52,475 INFO [RS:0;jenkins-hbase20:39185] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 01:04:52,475 INFO [RS:1;jenkins-hbase20:44505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 01:04:52,476 INFO [RS:0;jenkins-hbase20:39185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,475 INFO [RS:2;jenkins-hbase20:41693] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 01:04:52,476 INFO [RS:1;jenkins-hbase20:44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,476 INFO [RS:2;jenkins-hbase20:41693] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,483 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 01:04:52,483 INFO [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 01:04:52,483 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 01:04:52,491 INFO [RS:1;jenkins-hbase20:44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,491 INFO [RS:0;jenkins-hbase20:39185] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,491 INFO [RS:2;jenkins-hbase20:41693] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,491 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,491 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 01:04:52,492 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,492 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 01:04:52,493 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 01:04:52,492 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:2;jenkins-hbase20:41693] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:0;jenkins-hbase20:39185] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,493 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,494 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 01:04:52,494 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,495 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,496 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,496 INFO [RS:0;jenkins-hbase20:39185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,496 DEBUG [RS:1;jenkins-hbase20:44505] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 01:04:52,496 INFO [RS:0;jenkins-hbase20:39185] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,496 INFO [RS:0;jenkins-hbase20:39185] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,497 INFO [RS:2;jenkins-hbase20:41693] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,497 INFO [RS:2;jenkins-hbase20:41693] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,497 INFO [RS:2;jenkins-hbase20:41693] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,498 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 01:04:52,498 INFO [RS:1;jenkins-hbase20:44505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,499 INFO [RS:1;jenkins-hbase20:44505] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,499 INFO [RS:1;jenkins-hbase20:44505] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,510 INFO [RS:2;jenkins-hbase20:41693] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 01:04:52,511 INFO [RS:0;jenkins-hbase20:39185] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 01:04:52,514 INFO [RS:1;jenkins-hbase20:44505] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 01:04:52,514 INFO [RS:1;jenkins-hbase20:44505] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44505,1689123891229-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,514 INFO [RS:2;jenkins-hbase20:41693] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41693,1689123891259-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,514 INFO [RS:0;jenkins-hbase20:39185] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39185,1689123891188-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:52,535 INFO [RS:1;jenkins-hbase20:44505] regionserver.Replication(203): jenkins-hbase20.apache.org,44505,1689123891229 started 2023-07-12 01:04:52,535 INFO [RS:0;jenkins-hbase20:39185] regionserver.Replication(203): jenkins-hbase20.apache.org,39185,1689123891188 started 2023-07-12 01:04:52,535 INFO [RS:2;jenkins-hbase20:41693] regionserver.Replication(203): jenkins-hbase20.apache.org,41693,1689123891259 started 2023-07-12 01:04:52,535 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,39185,1689123891188, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:39185, sessionid=0x1007eb59db80001 2023-07-12 01:04:52,535 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44505,1689123891229, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44505, sessionid=0x1007eb59db80002 2023-07-12 01:04:52,535 INFO [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,41693,1689123891259, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41693, sessionid=0x1007eb59db80003 2023-07-12 01:04:52,536 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 01:04:52,536 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 01:04:52,536 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 01:04:52,536 DEBUG [RS:1;jenkins-hbase20:44505] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,536 DEBUG [RS:2;jenkins-hbase20:41693] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,537 DEBUG [RS:1;jenkins-hbase20:44505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44505,1689123891229' 2023-07-12 01:04:52,537 DEBUG [RS:2;jenkins-hbase20:41693] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41693,1689123891259' 2023-07-12 01:04:52,537 DEBUG [RS:1;jenkins-hbase20:44505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 01:04:52,537 DEBUG [RS:0;jenkins-hbase20:39185] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,537 DEBUG [RS:0;jenkins-hbase20:39185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39185,1689123891188' 2023-07-12 01:04:52,537 DEBUG [RS:0;jenkins-hbase20:39185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 01:04:52,537 DEBUG [RS:2;jenkins-hbase20:41693] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 01:04:52,538 DEBUG [RS:1;jenkins-hbase20:44505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 01:04:52,538 DEBUG [RS:2;jenkins-hbase20:41693] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 01:04:52,538 DEBUG [RS:0;jenkins-hbase20:39185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 01:04:52,538 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 01:04:52,538 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 01:04:52,538 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 01:04:52,539 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 01:04:52,539 DEBUG [RS:1;jenkins-hbase20:44505] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:52,539 DEBUG [RS:2;jenkins-hbase20:41693] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,539 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 01:04:52,539 DEBUG [RS:2;jenkins-hbase20:41693] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41693,1689123891259' 2023-07-12 01:04:52,539 DEBUG [RS:2;jenkins-hbase20:41693] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 01:04:52,539 DEBUG [RS:1;jenkins-hbase20:44505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44505,1689123891229' 2023-07-12 01:04:52,539 DEBUG [RS:1;jenkins-hbase20:44505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 01:04:52,539 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 01:04:52,540 DEBUG [RS:0;jenkins-hbase20:39185] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:52,540 DEBUG [RS:0;jenkins-hbase20:39185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39185,1689123891188' 2023-07-12 01:04:52,540 DEBUG [RS:0;jenkins-hbase20:39185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 01:04:52,540 DEBUG [RS:2;jenkins-hbase20:41693] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 01:04:52,540 DEBUG [RS:1;jenkins-hbase20:44505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 01:04:52,540 DEBUG [RS:0;jenkins-hbase20:39185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 01:04:52,540 DEBUG [RS:2;jenkins-hbase20:41693] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 01:04:52,541 DEBUG [RS:1;jenkins-hbase20:44505] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 01:04:52,541 INFO [RS:2;jenkins-hbase20:41693] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 01:04:52,541 INFO [RS:1;jenkins-hbase20:44505] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 01:04:52,541 INFO [RS:2;jenkins-hbase20:41693] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 01:04:52,541 INFO [RS:1;jenkins-hbase20:44505] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 01:04:52,542 DEBUG [RS:0;jenkins-hbase20:39185] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 01:04:52,542 INFO [RS:0;jenkins-hbase20:39185] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 01:04:52,542 INFO [RS:0;jenkins-hbase20:39185] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 01:04:52,650 DEBUG [jenkins-hbase20:37493] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 01:04:52,652 INFO [RS:2;jenkins-hbase20:41693] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41693%2C1689123891259, suffix=, logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259, archiveDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs, maxLogs=32 2023-07-12 01:04:52,652 INFO [RS:0;jenkins-hbase20:39185] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39185%2C1689123891188, suffix=, logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,39185,1689123891188, archiveDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs, maxLogs=32 2023-07-12 01:04:52,652 INFO [RS:1;jenkins-hbase20:44505] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44505%2C1689123891229, suffix=, logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,44505,1689123891229, archiveDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs, maxLogs=32 2023-07-12 01:04:52,655 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 01:04:52,661 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 01:04:52,661 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 01:04:52,661 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 01:04:52,661 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 01:04:52,663 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41693,1689123891259, state=OPENING 2023-07-12 01:04:52,684 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 01:04:52,684 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK] 2023-07-12 01:04:52,689 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK] 2023-07-12 01:04:52,690 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:52,691 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 01:04:52,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:52,696 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK] 2023-07-12 01:04:52,696 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK] 2023-07-12 01:04:52,700 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK] 2023-07-12 01:04:52,701 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK] 2023-07-12 01:04:52,701 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK] 2023-07-12 01:04:52,702 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK] 2023-07-12 01:04:52,702 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK] 2023-07-12 01:04:52,713 INFO [RS:2;jenkins-hbase20:41693] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 2023-07-12 01:04:52,717 DEBUG [RS:2;jenkins-hbase20:41693] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK], DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK]] 2023-07-12 01:04:52,718 INFO [RS:1;jenkins-hbase20:44505] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,44505,1689123891229/jenkins-hbase20.apache.org%2C44505%2C1689123891229.1689123892657 2023-07-12 01:04:52,718 INFO [RS:0;jenkins-hbase20:39185] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,39185,1689123891188/jenkins-hbase20.apache.org%2C39185%2C1689123891188.1689123892657 2023-07-12 01:04:52,718 DEBUG [RS:1;jenkins-hbase20:44505] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK], DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK]] 2023-07-12 01:04:52,719 DEBUG [RS:0;jenkins-hbase20:39185] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK], DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK]] 2023-07-12 01:04:52,885 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:52,889 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 01:04:52,892 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 01:04:52,907 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 01:04:52,907 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 01:04:52,911 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259, archiveDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs, maxLogs=32 2023-07-12 01:04:52,929 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK] 2023-07-12 01:04:52,929 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK] 2023-07-12 01:04:52,931 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK] 2023-07-12 01:04:52,940 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta 2023-07-12 01:04:52,941 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK], DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK]] 2023-07-12 01:04:52,942 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 01:04:52,945 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 01:04:52,963 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 01:04:52,967 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 01:04:52,971 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 01:04:52,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:52,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 01:04:52,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 01:04:52,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 01:04:52,977 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info 2023-07-12 01:04:52,977 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info 2023-07-12 01:04:52,977 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 01:04:52,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:52,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 01:04:52,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/rep_barrier 2023-07-12 01:04:52,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/rep_barrier 2023-07-12 01:04:52,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 01:04:52,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:52,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 01:04:52,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/table 2023-07-12 01:04:52,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/table 2023-07-12 01:04:52,985 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 01:04:52,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:52,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740 2023-07-12 01:04:52,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740 2023-07-12 01:04:52,995 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:52,997 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 01:04:52,998 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75070435, jitterRate=0.11863665282726288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:52,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 01:04:53,007 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689123892879 2023-07-12 01:04:53,024 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 01:04:53,025 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 01:04:53,026 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41693,1689123891259, state=OPEN 2023-07-12 01:04:53,028 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 01:04:53,028 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 01:04:53,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 01:04:53,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41693,1689123891259 in 333 msec 2023-07-12 01:04:53,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 01:04:53,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 561 msec 2023-07-12 01:04:53,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 863 msec 2023-07-12 01:04:53,043 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689123893043, completionTime=-1 2023-07-12 01:04:53,044 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 01:04:53,044 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:04:53,107 DEBUG [hconnection-0x4d656f2b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 01:04:53,111 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:04:53,125 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 01:04:53,126 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689123953125 2023-07-12 01:04:53,126 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689124013126 2023-07-12 01:04:53,126 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 81 msec 2023-07-12 01:04:53,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37493,1689123890227-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:53,155 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37493,1689123890227-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:53,156 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37493,1689123890227-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:53,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:37493, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:53,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 01:04:53,164 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 01:04:53,171 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 01:04:53,172 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 01:04:53,180 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 01:04:53,183 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 01:04:53,186 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 01:04:53,206 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,208 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313 empty. 2023-07-12 01:04:53,209 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,209 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 01:04:53,241 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 01:04:53,243 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => dbe2f930db8a844de8e08e57b489f313, NAME => 'hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:53,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:53,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing dbe2f930db8a844de8e08e57b489f313, disabling compactions & flushes 2023-07-12 01:04:53,264 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:04:53,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:04:53,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. after waiting 0 ms 2023-07-12 01:04:53,265 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:04:53,265 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:04:53,265 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for dbe2f930db8a844de8e08e57b489f313: 2023-07-12 01:04:53,269 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 01:04:53,283 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689123893273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123893273"}]},"ts":"1689123893273"} 2023-07-12 01:04:53,308 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 01:04:53,310 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 01:04:53,314 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689123893310"}]},"ts":"1689123893310"} 2023-07-12 01:04:53,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 01:04:53,322 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 01:04:53,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 01:04:53,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 01:04:53,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 01:04:53,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 01:04:53,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dbe2f930db8a844de8e08e57b489f313, ASSIGN}] 2023-07-12 01:04:53,330 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dbe2f930db8a844de8e08e57b489f313, ASSIGN 2023-07-12 01:04:53,331 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=dbe2f930db8a844de8e08e57b489f313, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:53,483 INFO [jenkins-hbase20:37493] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 01:04:53,484 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dbe2f930db8a844de8e08e57b489f313, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:53,484 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689123893484"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123893484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123893484"}]},"ts":"1689123893484"} 2023-07-12 01:04:53,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure dbe2f930db8a844de8e08e57b489f313, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:53,645 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:53,645 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 01:04:53,650 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 01:04:53,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:04:53,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbe2f930db8a844de8e08e57b489f313, NAME => 'hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313.', STARTKEY => '', ENDKEY => ''} 2023-07-12 01:04:53,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:53,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,663 INFO [StoreOpener-dbe2f930db8a844de8e08e57b489f313-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,666 DEBUG [StoreOpener-dbe2f930db8a844de8e08e57b489f313-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/info 2023-07-12 01:04:53,666 DEBUG [StoreOpener-dbe2f930db8a844de8e08e57b489f313-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/info 2023-07-12 01:04:53,666 INFO [StoreOpener-dbe2f930db8a844de8e08e57b489f313-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe2f930db8a844de8e08e57b489f313 columnFamilyName info 2023-07-12 01:04:53,667 INFO [StoreOpener-dbe2f930db8a844de8e08e57b489f313-1] regionserver.HStore(310): Store=dbe2f930db8a844de8e08e57b489f313/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:53,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:04:53,679 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:53,680 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened dbe2f930db8a844de8e08e57b489f313; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61697803, jitterRate=-0.08063109219074249}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 01:04:53,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for dbe2f930db8a844de8e08e57b489f313: 2023-07-12 01:04:53,682 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313., pid=6, masterSystemTime=1689123893645 2023-07-12 01:04:53,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:04:53,687 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:04:53,689 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dbe2f930db8a844de8e08e57b489f313, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:53,689 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689123893688"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123893688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123893688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123893688"}]},"ts":"1689123893688"} 2023-07-12 01:04:53,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 01:04:53,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure dbe2f930db8a844de8e08e57b489f313, server=jenkins-hbase20.apache.org,44505,1689123891229 in 204 msec 2023-07-12 01:04:53,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 01:04:53,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=dbe2f930db8a844de8e08e57b489f313, ASSIGN in 371 msec 2023-07-12 01:04:53,703 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 01:04:53,703 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689123893703"}]},"ts":"1689123893703"} 2023-07-12 01:04:53,705 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 01:04:53,708 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 01:04:53,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 535 msec 2023-07-12 01:04:53,783 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 01:04:53,785 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 01:04:53,785 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:04:53,804 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 01:04:53,807 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:04:53,819 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 01:04:53,836 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 01:04:53,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-07-12 01:04:53,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:04:53,865 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 01:04:53,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-12 01:04:53,884 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 01:04:53,886 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 01:04:53,886 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.573sec 2023-07-12 01:04:53,889 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 01:04:53,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 01:04:53,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 01:04:53,892 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37493,1689123890227-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 01:04:53,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37493,1689123890227-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 01:04:53,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 01:04:53,986 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ReadOnlyZKClient(139): Connect 0x7e481bac to 127.0.0.1:57181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 01:04:53,991 DEBUG [Listener at localhost.localdomain/45615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f762518, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 01:04:54,006 DEBUG [hconnection-0x225bbd80-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 01:04:54,018 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:04:54,026 INFO [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:54,027 WARN [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-12 01:04:54,036 DEBUG [Listener at localhost.localdomain/45615] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 01:04:54,039 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 01:04:54,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 01:04:54,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:04:54,061 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 01:04:54,064 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 01:04:54,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true" procId is: 9 2023-07-12 01:04:54,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 01:04:54,095 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:54,095 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:54,095 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:54,095 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:54,095 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:54,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703 2023-07-12 01:04:54,095 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:54,096 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:54,096 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5 empty. 2023-07-12 01:04:54,096 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f empty. 2023-07-12 01:04:54,096 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702 empty. 2023-07-12 01:04:54,097 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703 empty. 2023-07-12 01:04:54,097 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911 empty. 2023-07-12 01:04:54,099 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6 empty. 2023-07-12 01:04:54,099 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:54,099 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703 2023-07-12 01:04:54,099 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:54,099 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f empty. 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd empty. 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7 empty. 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:54,100 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff empty. 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b empty. 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:54,103 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634 empty. 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01 empty. 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8 empty. 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:54,104 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b empty. 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f empty. 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2 empty. 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b empty. 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169 empty. 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9 empty. 2023-07-12 01:04:54,105 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e empty. 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:54,106 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169 2023-07-12 01:04:54,107 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4 empty. 2023-07-12 01:04:54,107 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca empty. 2023-07-12 01:04:54,109 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:54,109 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:54,109 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c empty. 2023-07-12 01:04:54,109 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869 empty. 2023-07-12 01:04:54,110 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8 empty. 2023-07-12 01:04:54,110 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:54,110 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:54,110 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:54,110 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:54,110 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:54,110 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true regions 2023-07-12 01:04:54,130 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/.tabledesc/.tableinfo.0000000001 2023-07-12 01:04:54,135 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca889399af08ba65a850adb2ee8395d6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6.', STARTKEY => '', ENDKEY => 'bbb'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,135 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0228227e8813717a42ebc01d7ead1bf5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.', STARTKEY => 'bbb', ENDKEY => 'ccc'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,136 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => a9225a5a58a47bc81419c3c6486161fd, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd.', STARTKEY => 'ccc', ENDKEY => 'ddd'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,178 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,178 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing a9225a5a58a47bc81419c3c6486161fd, disabling compactions & flushes 2023-07-12 01:04:54,179 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:54,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:54,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. after waiting 0 ms 2023-07-12 01:04:54,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:54,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,179 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:54,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing ca889399af08ba65a850adb2ee8395d6, disabling compactions & flushes 2023-07-12 01:04:54,179 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for a9225a5a58a47bc81419c3c6486161fd: 2023-07-12 01:04:54,179 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:54,180 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:54,180 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. after waiting 0 ms 2023-07-12 01:04:54,180 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 75325405355a259b4d0cf0a74bbcd911, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911.', STARTKEY => 'ddd', ENDKEY => 'eee'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,180 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:54,180 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,180 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:54,181 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 0228227e8813717a42ebc01d7ead1bf5, disabling compactions & flushes 2023-07-12 01:04:54,181 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for ca889399af08ba65a850adb2ee8395d6: 2023-07-12 01:04:54,181 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:04:54,182 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:04:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 01:04:54,182 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => a4286f94dc74b552274bbaef598de52f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.', STARTKEY => 'eee', ENDKEY => 'fff'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,182 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. after waiting 0 ms 2023-07-12 01:04:54,182 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:04:54,182 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:04:54,182 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 0228227e8813717a42ebc01d7ead1bf5: 2023-07-12 01:04:54,183 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1a85da1c5071914c49b60e5af919979f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f.', STARTKEY => 'fff', ENDKEY => 'ggg'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,208 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,209 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 75325405355a259b4d0cf0a74bbcd911, disabling compactions & flushes 2023-07-12 01:04:54,209 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:04:54,209 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:04:54,209 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. after waiting 0 ms 2023-07-12 01:04:54,210 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:04:54,210 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:04:54,210 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 75325405355a259b4d0cf0a74bbcd911: 2023-07-12 01:04:54,212 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => b658a8e97de14ce8106a1feb87599702, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702.', STARTKEY => 'ggg', ENDKEY => 'hhh'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,214 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,214 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,217 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 1a85da1c5071914c49b60e5af919979f, disabling compactions & flushes 2023-07-12 01:04:54,219 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing a4286f94dc74b552274bbaef598de52f, disabling compactions & flushes 2023-07-12 01:04:54,219 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:04:54,219 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:04:54,219 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:04:54,219 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:04:54,219 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. after waiting 0 ms 2023-07-12 01:04:54,220 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. after waiting 0 ms 2023-07-12 01:04:54,220 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:04:54,220 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:04:54,220 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:04:54,220 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:04:54,220 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 1a85da1c5071914c49b60e5af919979f: 2023-07-12 01:04:54,220 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for a4286f94dc74b552274bbaef598de52f: 2023-07-12 01:04:54,220 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => bda21464bb715c3e773728044115c703, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703.', STARTKEY => 'hhh', ENDKEY => 'iii'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,221 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 840da36b068ca121abcf9b125401ce01, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01.', STARTKEY => 'iii', ENDKEY => 'jjj'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,259 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,260 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing b658a8e97de14ce8106a1feb87599702, disabling compactions & flushes 2023-07-12 01:04:54,260 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:04:54,260 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:04:54,260 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. after waiting 0 ms 2023-07-12 01:04:54,260 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:04:54,260 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:04:54,260 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for b658a8e97de14ce8106a1feb87599702: 2023-07-12 01:04:54,261 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 6fa622b2d252cd13cd3d1492a2b2abf7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7.', STARTKEY => 'jjj', ENDKEY => 'kkk'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,305 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,305 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 6fa622b2d252cd13cd3d1492a2b2abf7, disabling compactions & flushes 2023-07-12 01:04:54,305 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:04:54,305 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:04:54,305 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. after waiting 0 ms 2023-07-12 01:04:54,305 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:04:54,305 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:04:54,306 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 6fa622b2d252cd13cd3d1492a2b2abf7: 2023-07-12 01:04:54,306 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 488292cb0f12944b5c0dae2af2ac0634, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.', STARTKEY => 'kkk', ENDKEY => 'lll'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,320 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,320 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 488292cb0f12944b5c0dae2af2ac0634, disabling compactions & flushes 2023-07-12 01:04:54,320 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:04:54,320 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:04:54,320 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. after waiting 0 ms 2023-07-12 01:04:54,320 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:04:54,320 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:04:54,320 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 488292cb0f12944b5c0dae2af2ac0634: 2023-07-12 01:04:54,321 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => f7fbdaddce570c27d6ee9957a9c6151b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b.', STARTKEY => 'lll', ENDKEY => 'mmm'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,339 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,339 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing f7fbdaddce570c27d6ee9957a9c6151b, disabling compactions & flushes 2023-07-12 01:04:54,339 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:04:54,339 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:04:54,339 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. after waiting 0 ms 2023-07-12 01:04:54,339 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:04:54,339 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:04:54,340 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for f7fbdaddce570c27d6ee9957a9c6151b: 2023-07-12 01:04:54,340 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5dc4f4467bffce1548aaf5c0a32a17ff, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff.', STARTKEY => 'mmm', ENDKEY => 'nnn'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,356 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,356 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 5dc4f4467bffce1548aaf5c0a32a17ff, disabling compactions & flushes 2023-07-12 01:04:54,356 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:04:54,356 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:04:54,356 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. after waiting 0 ms 2023-07-12 01:04:54,356 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:04:54,356 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:04:54,357 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 5dc4f4467bffce1548aaf5c0a32a17ff: 2023-07-12 01:04:54,357 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 695e737124e815d7b26e317639623da8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.', STARTKEY => 'nnn', ENDKEY => 'ooo'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,370 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,371 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 695e737124e815d7b26e317639623da8, disabling compactions & flushes 2023-07-12 01:04:54,371 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:04:54,371 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:04:54,371 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. after waiting 0 ms 2023-07-12 01:04:54,371 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:04:54,371 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:04:54,371 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 695e737124e815d7b26e317639623da8: 2023-07-12 01:04:54,371 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => e82c5c0900eccdfd36d246bfd483cc8b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b.', STARTKEY => 'ooo', ENDKEY => 'ppp'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 01:04:54,386 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,386 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing e82c5c0900eccdfd36d246bfd483cc8b, disabling compactions & flushes 2023-07-12 01:04:54,386 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:04:54,386 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:04:54,386 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. after waiting 0 ms 2023-07-12 01:04:54,386 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:04:54,386 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:04:54,386 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for e82c5c0900eccdfd36d246bfd483cc8b: 2023-07-12 01:04:54,387 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => fdadbca7962190644ed85497b5875169, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169.', STARTKEY => 'ppp', ENDKEY => 'qqq'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing fdadbca7962190644ed85497b5875169, disabling compactions & flushes 2023-07-12 01:04:54,402 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:04:54,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:04:54,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. after waiting 0 ms 2023-07-12 01:04:54,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:04:54,402 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:04:54,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for fdadbca7962190644ed85497b5875169: 2023-07-12 01:04:54,403 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => f8578d7595773e9fb4bf660e4e4d3ef2, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.', STARTKEY => 'qqq', ENDKEY => 'rrr'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,416 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,416 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing f8578d7595773e9fb4bf660e4e4d3ef2, disabling compactions & flushes 2023-07-12 01:04:54,416 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:04:54,416 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:04:54,416 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. after waiting 0 ms 2023-07-12 01:04:54,416 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:04:54,416 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:04:54,416 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for f8578d7595773e9fb4bf660e4e4d3ef2: 2023-07-12 01:04:54,417 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9e812d33d7edfde6f8072cd607e5557f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f.', STARTKEY => 'rrr', ENDKEY => 'sss'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,430 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,430 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 9e812d33d7edfde6f8072cd607e5557f, disabling compactions & flushes 2023-07-12 01:04:54,430 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:04:54,430 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:04:54,430 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. after waiting 0 ms 2023-07-12 01:04:54,430 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:04:54,430 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:04:54,430 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 9e812d33d7edfde6f8072cd607e5557f: 2023-07-12 01:04:54,430 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 863b75dea6bb4708953712d4bdadae9b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b.', STARTKEY => 'sss', ENDKEY => 'ttt'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,445 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,446 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 863b75dea6bb4708953712d4bdadae9b, disabling compactions & flushes 2023-07-12 01:04:54,446 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:04:54,446 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:04:54,446 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. after waiting 0 ms 2023-07-12 01:04:54,446 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:04:54,446 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:04:54,446 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 863b75dea6bb4708953712d4bdadae9b: 2023-07-12 01:04:54,446 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => c4b65efc1028505129667bcbcaa0e7c9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.', STARTKEY => 'ttt', ENDKEY => 'uuu'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,458 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,458 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing c4b65efc1028505129667bcbcaa0e7c9, disabling compactions & flushes 2023-07-12 01:04:54,458 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:04:54,458 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:04:54,458 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. after waiting 0 ms 2023-07-12 01:04:54,458 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:04:54,458 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:04:54,458 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for c4b65efc1028505129667bcbcaa0e7c9: 2023-07-12 01:04:54,458 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 6724d7b4d9c33a2381ae9fe74f47e1f4, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4.', STARTKEY => 'uuu', ENDKEY => 'vvv'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,472 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,472 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 6724d7b4d9c33a2381ae9fe74f47e1f4, disabling compactions & flushes 2023-07-12 01:04:54,472 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:04:54,472 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:04:54,472 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. after waiting 0 ms 2023-07-12 01:04:54,472 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:04:54,473 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:04:54,473 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 6724d7b4d9c33a2381ae9fe74f47e1f4: 2023-07-12 01:04:54,473 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 4387a308fe1e2027fcba9289c9f7579e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e.', STARTKEY => 'vvv', ENDKEY => 'www'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,485 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,485 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 4387a308fe1e2027fcba9289c9f7579e, disabling compactions & flushes 2023-07-12 01:04:54,485 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:04:54,485 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:04:54,485 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. after waiting 0 ms 2023-07-12 01:04:54,485 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:04:54,485 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:04:54,485 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 4387a308fe1e2027fcba9289c9f7579e: 2023-07-12 01:04:54,486 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 961cbfe10cb28b1216894773e3260869, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.', STARTKEY => 'www', ENDKEY => 'xxx'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,498 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,498 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 961cbfe10cb28b1216894773e3260869, disabling compactions & flushes 2023-07-12 01:04:54,498 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:04:54,499 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:04:54,499 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. after waiting 0 ms 2023-07-12 01:04:54,499 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:04:54,499 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:04:54,499 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 961cbfe10cb28b1216894773e3260869: 2023-07-12 01:04:54,499 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 594b8a8fea092d1d008b127b6f92abca, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca.', STARTKEY => 'xxx', ENDKEY => 'yyy'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,524 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,524 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 594b8a8fea092d1d008b127b6f92abca, disabling compactions & flushes 2023-07-12 01:04:54,524 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:04:54,524 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:04:54,524 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. after waiting 0 ms 2023-07-12 01:04:54,524 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:04:54,524 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:04:54,524 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 594b8a8fea092d1d008b127b6f92abca: 2023-07-12 01:04:54,525 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => a009cfd3f7c2b56662acd253b84f912c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c.', STARTKEY => 'yyy', ENDKEY => 'zzz'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,541 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,541 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing a009cfd3f7c2b56662acd253b84f912c, disabling compactions & flushes 2023-07-12 01:04:54,541 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:04:54,541 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:04:54,542 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. after waiting 0 ms 2023-07-12 01:04:54,542 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:04:54,542 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:04:54,542 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for a009cfd3f7c2b56662acd253b84f912c: 2023-07-12 01:04:54,542 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 120c8b9db387dd5301dffc921c87e0d8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.', STARTKEY => 'zzz', ENDKEY => ''}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/.tmp 2023-07-12 01:04:54,556 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,556 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 120c8b9db387dd5301dffc921c87e0d8, disabling compactions & flushes 2023-07-12 01:04:54,557 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:04:54,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:04:54,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. after waiting 0 ms 2023-07-12 01:04:54,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:04:54,557 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:04:54,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 120c8b9db387dd5301dffc921c87e0d8: 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 840da36b068ca121abcf9b125401ce01, disabling compactions & flushes 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing bda21464bb715c3e773728044115c703, disabling compactions & flushes 2023-07-12 01:04:54,655 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. after waiting 0 ms 2023-07-12 01:04:54,655 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:04:54,655 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. after waiting 0 ms 2023-07-12 01:04:54,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for bda21464bb715c3e773728044115c703: 2023-07-12 01:04:54,656 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:04:54,656 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:04:54,656 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 840da36b068ca121abcf9b125401ce01: 2023-07-12 01:04:54,661 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 01:04:54,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689123894662"}]},"ts":"1689123894662"} 2023-07-12 01:04:54,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 01:04:54,709 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 26 regions to meta. 2023-07-12 01:04:54,711 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 01:04:54,711 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689123894711"}]},"ts":"1689123894711"} 2023-07-12 01:04:54,714 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLING in hbase:meta 2023-07-12 01:04:54,716 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 01:04:54,749 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 01:04:54,749 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 01:04:54,749 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 01:04:54,749 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 01:04:54,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca889399af08ba65a850adb2ee8395d6, ASSIGN}, {pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN}, {pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a9225a5a58a47bc81419c3c6486161fd, ASSIGN}, {pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=75325405355a259b4d0cf0a74bbcd911, ASSIGN}, {pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN}, {pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1a85da1c5071914c49b60e5af919979f, ASSIGN}, {pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b658a8e97de14ce8106a1feb87599702, ASSIGN}, {pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bda21464bb715c3e773728044115c703, ASSIGN}, {pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=840da36b068ca121abcf9b125401ce01, ASSIGN}, {pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fa622b2d252cd13cd3d1492a2b2abf7, ASSIGN}, {pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN}, {pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f7fbdaddce570c27d6ee9957a9c6151b, ASSIGN}, {pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5dc4f4467bffce1548aaf5c0a32a17ff, ASSIGN}, {pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN}, {pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e82c5c0900eccdfd36d246bfd483cc8b, ASSIGN}, {pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdadbca7962190644ed85497b5875169, ASSIGN}, {pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN}, {pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e812d33d7edfde6f8072cd607e5557f, ASSIGN}, {pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=863b75dea6bb4708953712d4bdadae9b, ASSIGN}, {pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN}, {pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6724d7b4d9c33a2381ae9fe74f47e1f4, ASSIGN}, {pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4387a308fe1e2027fcba9289c9f7579e, ASSIGN}, {pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN}, {pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=594b8a8fea092d1d008b127b6f92abca, ASSIGN}, {pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a009cfd3f7c2b56662acd253b84f912c, ASSIGN}, {pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN}] 2023-07-12 01:04:54,760 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN 2023-07-12 01:04:54,762 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,763 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a009cfd3f7c2b56662acd253b84f912c, ASSIGN 2023-07-12 01:04:54,764 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a009cfd3f7c2b56662acd253b84f912c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,765 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=594b8a8fea092d1d008b127b6f92abca, ASSIGN 2023-07-12 01:04:54,766 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=594b8a8fea092d1d008b127b6f92abca, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,768 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN 2023-07-12 01:04:54,769 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,770 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4387a308fe1e2027fcba9289c9f7579e, ASSIGN 2023-07-12 01:04:54,771 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4387a308fe1e2027fcba9289c9f7579e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,772 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6724d7b4d9c33a2381ae9fe74f47e1f4, ASSIGN 2023-07-12 01:04:54,773 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6724d7b4d9c33a2381ae9fe74f47e1f4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,774 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN 2023-07-12 01:04:54,775 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,776 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=863b75dea6bb4708953712d4bdadae9b, ASSIGN 2023-07-12 01:04:54,777 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=863b75dea6bb4708953712d4bdadae9b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,778 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e812d33d7edfde6f8072cd607e5557f, ASSIGN 2023-07-12 01:04:54,779 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e812d33d7edfde6f8072cd607e5557f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,780 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN 2023-07-12 01:04:54,781 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,782 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdadbca7962190644ed85497b5875169, ASSIGN 2023-07-12 01:04:54,783 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdadbca7962190644ed85497b5875169, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,784 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e82c5c0900eccdfd36d246bfd483cc8b, ASSIGN 2023-07-12 01:04:54,785 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e82c5c0900eccdfd36d246bfd483cc8b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,786 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN 2023-07-12 01:04:54,787 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,788 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5dc4f4467bffce1548aaf5c0a32a17ff, ASSIGN 2023-07-12 01:04:54,789 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5dc4f4467bffce1548aaf5c0a32a17ff, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,790 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f7fbdaddce570c27d6ee9957a9c6151b, ASSIGN 2023-07-12 01:04:54,791 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f7fbdaddce570c27d6ee9957a9c6151b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,792 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN 2023-07-12 01:04:54,793 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,794 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fa622b2d252cd13cd3d1492a2b2abf7, ASSIGN 2023-07-12 01:04:54,795 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fa622b2d252cd13cd3d1492a2b2abf7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,796 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=840da36b068ca121abcf9b125401ce01, ASSIGN 2023-07-12 01:04:54,797 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=840da36b068ca121abcf9b125401ce01, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,799 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bda21464bb715c3e773728044115c703, ASSIGN 2023-07-12 01:04:54,800 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bda21464bb715c3e773728044115c703, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,801 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b658a8e97de14ce8106a1feb87599702, ASSIGN 2023-07-12 01:04:54,802 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b658a8e97de14ce8106a1feb87599702, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,803 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1a85da1c5071914c49b60e5af919979f, ASSIGN 2023-07-12 01:04:54,804 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1a85da1c5071914c49b60e5af919979f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,805 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN 2023-07-12 01:04:54,806 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,807 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=75325405355a259b4d0cf0a74bbcd911, ASSIGN 2023-07-12 01:04:54,808 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=75325405355a259b4d0cf0a74bbcd911, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,809 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a9225a5a58a47bc81419c3c6486161fd, ASSIGN 2023-07-12 01:04:54,810 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a9225a5a58a47bc81419c3c6486161fd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44505,1689123891229; forceNewPlan=false, retain=false 2023-07-12 01:04:54,811 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN 2023-07-12 01:04:54,812 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41693,1689123891259; forceNewPlan=false, retain=false 2023-07-12 01:04:54,813 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca889399af08ba65a850adb2ee8395d6, ASSIGN 2023-07-12 01:04:54,814 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca889399af08ba65a850adb2ee8395d6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39185,1689123891188; forceNewPlan=false, retain=false 2023-07-12 01:04:54,912 INFO [jenkins-hbase20:37493] balancer.BaseLoadBalancer(1545): Reassigned 26 regions. 26 retained the pre-restart assignment. 2023-07-12 01:04:54,922 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=75325405355a259b4d0cf0a74bbcd911, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,922 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894922"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894922"}]},"ts":"1689123894922"} 2023-07-12 01:04:54,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=13, state=RUNNABLE; OpenRegionProcedure 75325405355a259b4d0cf0a74bbcd911, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=9e812d33d7edfde6f8072cd607e5557f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,930 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894930"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894930"}]},"ts":"1689123894930"} 2023-07-12 01:04:54,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=27, state=RUNNABLE; OpenRegionProcedure 9e812d33d7edfde6f8072cd607e5557f, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,938 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,938 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894938"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894938"}]},"ts":"1689123894938"} 2023-07-12 01:04:54,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=24, state=RUNNABLE; OpenRegionProcedure e82c5c0900eccdfd36d246bfd483cc8b, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,946 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a9225a5a58a47bc81419c3c6486161fd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,946 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894946"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894946"}]},"ts":"1689123894946"} 2023-07-12 01:04:54,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=12, state=RUNNABLE; OpenRegionProcedure a9225a5a58a47bc81419c3c6486161fd, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,954 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,954 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894954"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894954"}]},"ts":"1689123894954"} 2023-07-12 01:04:54,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=30, state=RUNNABLE; OpenRegionProcedure 6724d7b4d9c33a2381ae9fe74f47e1f4, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,961 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bda21464bb715c3e773728044115c703, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,962 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894961"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894961"}]},"ts":"1689123894961"} 2023-07-12 01:04:54,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=17, state=RUNNABLE; OpenRegionProcedure bda21464bb715c3e773728044115c703, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,969 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b658a8e97de14ce8106a1feb87599702, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894969"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894969"}]},"ts":"1689123894969"} 2023-07-12 01:04:54,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=16, state=RUNNABLE; OpenRegionProcedure b658a8e97de14ce8106a1feb87599702, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=594b8a8fea092d1d008b127b6f92abca, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894976"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894976"}]},"ts":"1689123894976"} 2023-07-12 01:04:54,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=33, state=RUNNABLE; OpenRegionProcedure 594b8a8fea092d1d008b127b6f92abca, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,983 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:54,983 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894983"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894983"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894983"}]},"ts":"1689123894983"} 2023-07-12 01:04:54,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=21, state=RUNNABLE; OpenRegionProcedure f7fbdaddce570c27d6ee9957a9c6151b, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:04:54,990 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:54,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894990"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894990"}]},"ts":"1689123894990"} 2023-07-12 01:04:54,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=29, state=RUNNABLE; OpenRegionProcedure c4b65efc1028505129667bcbcaa0e7c9, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:54,997 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0228227e8813717a42ebc01d7ead1bf5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:54,998 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123894997"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123894997"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123894997"}]},"ts":"1689123894997"} 2023-07-12 01:04:55,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=11, state=RUNNABLE; OpenRegionProcedure 0228227e8813717a42ebc01d7ead1bf5, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:55,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895004"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895004"}]},"ts":"1689123895004"} 2023-07-12 01:04:55,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=26, state=RUNNABLE; OpenRegionProcedure f8578d7595773e9fb4bf660e4e4d3ef2, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:55,011 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a4286f94dc74b552274bbaef598de52f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,011 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895011"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895011"}]},"ts":"1689123895011"} 2023-07-12 01:04:55,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=14, state=RUNNABLE; OpenRegionProcedure a4286f94dc74b552274bbaef598de52f, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:55,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=488292cb0f12944b5c0dae2af2ac0634, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895017"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895017"}]},"ts":"1689123895017"} 2023-07-12 01:04:55,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=20, state=RUNNABLE; OpenRegionProcedure 488292cb0f12944b5c0dae2af2ac0634, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:55,023 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=120c8b9db387dd5301dffc921c87e0d8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,024 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689123895023"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895023"}]},"ts":"1689123895023"} 2023-07-12 01:04:55,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=35, state=RUNNABLE; OpenRegionProcedure 120c8b9db387dd5301dffc921c87e0d8, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:55,030 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=961cbfe10cb28b1216894773e3260869, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,030 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895030"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895030"}]},"ts":"1689123895030"} 2023-07-12 01:04:55,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=32, state=RUNNABLE; OpenRegionProcedure 961cbfe10cb28b1216894773e3260869, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:55,036 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=695e737124e815d7b26e317639623da8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,036 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895036"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895036"}]},"ts":"1689123895036"} 2023-07-12 01:04:55,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=23, state=RUNNABLE; OpenRegionProcedure 695e737124e815d7b26e317639623da8, server=jenkins-hbase20.apache.org,41693,1689123891259}] 2023-07-12 01:04:55,043 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,043 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895043"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895043"}]},"ts":"1689123895043"} 2023-07-12 01:04:55,048 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=19, state=RUNNABLE; OpenRegionProcedure 6fa622b2d252cd13cd3d1492a2b2abf7, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ca889399af08ba65a850adb2ee8395d6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,053 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689123895052"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895052"}]},"ts":"1689123895052"} 2023-07-12 01:04:55,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=10, state=RUNNABLE; OpenRegionProcedure ca889399af08ba65a850adb2ee8395d6, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,058 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=a009cfd3f7c2b56662acd253b84f912c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,058 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895058"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895058"}]},"ts":"1689123895058"} 2023-07-12 01:04:55,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=34, state=RUNNABLE; OpenRegionProcedure a009cfd3f7c2b56662acd253b84f912c, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,063 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1a85da1c5071914c49b60e5af919979f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,064 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895063"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895063"}]},"ts":"1689123895063"} 2023-07-12 01:04:55,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=15, state=RUNNABLE; OpenRegionProcedure 1a85da1c5071914c49b60e5af919979f, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,069 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=840da36b068ca121abcf9b125401ce01, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,069 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895069"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895069"}]},"ts":"1689123895069"} 2023-07-12 01:04:55,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=18, state=RUNNABLE; OpenRegionProcedure 840da36b068ca121abcf9b125401ce01, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=fdadbca7962190644ed85497b5875169, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895074"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895074"}]},"ts":"1689123895074"} 2023-07-12 01:04:55,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=25, state=RUNNABLE; OpenRegionProcedure fdadbca7962190644ed85497b5875169, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,079 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,080 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895079"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895079"}]},"ts":"1689123895079"} 2023-07-12 01:04:55,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=59, ppid=22, state=RUNNABLE; OpenRegionProcedure 5dc4f4467bffce1548aaf5c0a32a17ff, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:04:55,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bda21464bb715c3e773728044115c703, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2023-07-12 01:04:55,086 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=4387a308fe1e2027fcba9289c9f7579e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895086"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895086"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895086"}]},"ts":"1689123895086"} 2023-07-12 01:04:55,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=31, state=RUNNABLE; OpenRegionProcedure 4387a308fe1e2027fcba9289c9f7579e, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,089 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,091 DEBUG [StoreOpener-bda21464bb715c3e773728044115c703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily11 2023-07-12 01:04:55,091 DEBUG [StoreOpener-bda21464bb715c3e773728044115c703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily11 2023-07-12 01:04:55,092 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda21464bb715c3e773728044115c703 columnFamilyName colfamily11 2023-07-12 01:04:55,093 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] regionserver.HStore(310): Store=bda21464bb715c3e773728044115c703/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,093 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=863b75dea6bb4708953712d4bdadae9b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,094 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,094 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895093"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689123895093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689123895093"}]},"ts":"1689123895093"} 2023-07-12 01:04:55,096 DEBUG [StoreOpener-bda21464bb715c3e773728044115c703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily21 2023-07-12 01:04:55,096 DEBUG [StoreOpener-bda21464bb715c3e773728044115c703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily21 2023-07-12 01:04:55,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=28, state=RUNNABLE; OpenRegionProcedure 863b75dea6bb4708953712d4bdadae9b, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:04:55,097 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda21464bb715c3e773728044115c703 columnFamilyName colfamily21 2023-07-12 01:04:55,097 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] regionserver.HStore(310): Store=bda21464bb715c3e773728044115c703/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,098 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,100 DEBUG [StoreOpener-bda21464bb715c3e773728044115c703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily31 2023-07-12 01:04:55,100 DEBUG [StoreOpener-bda21464bb715c3e773728044115c703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily31 2023-07-12 01:04:55,100 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda21464bb715c3e773728044115c703 columnFamilyName colfamily31 2023-07-12 01:04:55,101 INFO [StoreOpener-bda21464bb715c3e773728044115c703-1] regionserver.HStore(310): Store=bda21464bb715c3e773728044115c703/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bda21464bb715c3e773728044115c703 2023-07-12 01:04:55,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bda21464bb715c3e773728044115c703; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73306156, jitterRate=0.09234684705734253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bda21464bb715c3e773728044115c703: 2023-07-12 01:04:55,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703., pid=41, masterSystemTime=1689123895078 2023-07-12 01:04:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:04:55,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:04:55,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:04:55,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7fbdaddce570c27d6ee9957a9c6151b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2023-07-12 01:04:55,117 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bda21464bb715c3e773728044115c703, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,117 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895117"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895117"}]},"ts":"1689123895117"} 2023-07-12 01:04:55,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,119 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,123 DEBUG [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily11 2023-07-12 01:04:55,123 DEBUG [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily11 2023-07-12 01:04:55,124 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7fbdaddce570c27d6ee9957a9c6151b columnFamilyName colfamily11 2023-07-12 01:04:55,124 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] regionserver.HStore(310): Store=f7fbdaddce570c27d6ee9957a9c6151b/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,125 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=17 2023-07-12 01:04:55,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=17, state=SUCCESS; OpenRegionProcedure bda21464bb715c3e773728044115c703, server=jenkins-hbase20.apache.org,44505,1689123891229 in 157 msec 2023-07-12 01:04:55,128 DEBUG [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily21 2023-07-12 01:04:55,128 DEBUG [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily21 2023-07-12 01:04:55,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bda21464bb715c3e773728044115c703, ASSIGN in 377 msec 2023-07-12 01:04:55,129 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7fbdaddce570c27d6ee9957a9c6151b columnFamilyName colfamily21 2023-07-12 01:04:55,129 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] regionserver.HStore(310): Store=f7fbdaddce570c27d6ee9957a9c6151b/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,130 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,131 DEBUG [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily31 2023-07-12 01:04:55,132 DEBUG [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily31 2023-07-12 01:04:55,132 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7fbdaddce570c27d6ee9957a9c6151b columnFamilyName colfamily31 2023-07-12 01:04:55,133 INFO [StoreOpener-f7fbdaddce570c27d6ee9957a9c6151b-1] regionserver.HStore(310): Store=f7fbdaddce570c27d6ee9957a9c6151b/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:04:55,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f7fbdaddce570c27d6ee9957a9c6151b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63555748, jitterRate=-0.05294555425643921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f7fbdaddce570c27d6ee9957a9c6151b: 2023-07-12 01:04:55,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b., pid=44, masterSystemTime=1689123895078 2023-07-12 01:04:55,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:04:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0228227e8813717a42ebc01d7ead1bf5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-12 01:04:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:04:55,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:04:55,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:04:55,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b658a8e97de14ce8106a1feb87599702, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2023-07-12 01:04:55,154 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,154 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895154"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895154"}]},"ts":"1689123895154"} 2023-07-12 01:04:55,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,156 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,157 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,161 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily11 2023-07-12 01:04:55,161 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily11 2023-07-12 01:04:55,161 DEBUG [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily11 2023-07-12 01:04:55,161 DEBUG [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily11 2023-07-12 01:04:55,162 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0228227e8813717a42ebc01d7ead1bf5 columnFamilyName colfamily11 2023-07-12 01:04:55,163 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(310): Store=0228227e8813717a42ebc01d7ead1bf5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,163 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,163 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b658a8e97de14ce8106a1feb87599702 columnFamilyName colfamily11 2023-07-12 01:04:55,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=21 2023-07-12 01:04:55,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=21, state=SUCCESS; OpenRegionProcedure f7fbdaddce570c27d6ee9957a9c6151b, server=jenkins-hbase20.apache.org,44505,1689123891229 in 171 msec 2023-07-12 01:04:55,173 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] regionserver.HStore(310): Store=b658a8e97de14ce8106a1feb87599702/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,174 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,175 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily21 2023-07-12 01:04:55,175 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily21 2023-07-12 01:04:55,176 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0228227e8813717a42ebc01d7ead1bf5 columnFamilyName colfamily21 2023-07-12 01:04:55,177 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(310): Store=0228227e8813717a42ebc01d7ead1bf5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f7fbdaddce570c27d6ee9957a9c6151b, ASSIGN in 422 msec 2023-07-12 01:04:55,178 DEBUG [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily21 2023-07-12 01:04:55,177 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,178 DEBUG [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily21 2023-07-12 01:04:55,178 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b658a8e97de14ce8106a1feb87599702 columnFamilyName colfamily21 2023-07-12 01:04:55,179 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] regionserver.HStore(310): Store=b658a8e97de14ce8106a1feb87599702/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,180 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,180 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily31 2023-07-12 01:04:55,181 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily31 2023-07-12 01:04:55,181 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0228227e8813717a42ebc01d7ead1bf5 columnFamilyName colfamily31 2023-07-12 01:04:55,182 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(310): Store=0228227e8813717a42ebc01d7ead1bf5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,183 DEBUG [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily31 2023-07-12 01:04:55,184 DEBUG [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily31 2023-07-12 01:04:55,184 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b658a8e97de14ce8106a1feb87599702 columnFamilyName colfamily31 2023-07-12 01:04:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,185 INFO [StoreOpener-b658a8e97de14ce8106a1feb87599702-1] regionserver.HStore(310): Store=b658a8e97de14ce8106a1feb87599702/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 01:04:55,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:04:55,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b658a8e97de14ce8106a1feb87599702 2023-07-12 01:04:55,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0228227e8813717a42ebc01d7ead1bf5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66192681, jitterRate=-0.013652190566062927}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0228227e8813717a42ebc01d7ead1bf5: 2023-07-12 01:04:55,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5., pid=46, masterSystemTime=1689123895144 2023-07-12 01:04:55,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:04:55,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b658a8e97de14ce8106a1feb87599702; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71780600, jitterRate=0.06961429119110107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b658a8e97de14ce8106a1feb87599702: 2023-07-12 01:04:55,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:04:55,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:04:55,198 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4b65efc1028505129667bcbcaa0e7c9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-12 01:04:55,198 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895198"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895198"}]},"ts":"1689123895198"} 2023-07-12 01:04:55,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702., pid=42, masterSystemTime=1689123895078 2023-07-12 01:04:55,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:04:55,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:04:55,202 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:55,203 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 01:04:55,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9225a5a58a47bc81419c3c6486161fd, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-12 01:04:55,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,207 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=11 2023-07-12 01:04:55,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=11, state=SUCCESS; OpenRegionProcedure 0228227e8813717a42ebc01d7ead1bf5, server=jenkins-hbase20.apache.org,41693,1689123891259 in 202 msec 2023-07-12 01:04:55,212 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily11 2023-07-12 01:04:55,213 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,213 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily11 2023-07-12 01:04:55,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN in 459 msec 2023-07-12 01:04:55,215 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 01:04:55,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b658a8e97de14ce8106a1feb87599702, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,215 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4b65efc1028505129667bcbcaa0e7c9 columnFamilyName colfamily11 2023-07-12 01:04:55,216 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895215"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895215"}]},"ts":"1689123895215"} 2023-07-12 01:04:55,217 DEBUG [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily11 2023-07-12 01:04:55,219 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(310): Store=c4b65efc1028505129667bcbcaa0e7c9/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,219 DEBUG [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily11 2023-07-12 01:04:55,220 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,222 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9225a5a58a47bc81419c3c6486161fd columnFamilyName colfamily11 2023-07-12 01:04:55,223 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] regionserver.HStore(310): Store=a9225a5a58a47bc81419c3c6486161fd/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,223 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,224 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily21 2023-07-12 01:04:55,224 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily21 2023-07-12 01:04:55,225 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4b65efc1028505129667bcbcaa0e7c9 columnFamilyName colfamily21 2023-07-12 01:04:55,226 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(310): Store=c4b65efc1028505129667bcbcaa0e7c9/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,226 DEBUG [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily21 2023-07-12 01:04:55,226 DEBUG [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily21 2023-07-12 01:04:55,226 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,227 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9225a5a58a47bc81419c3c6486161fd columnFamilyName colfamily21 2023-07-12 01:04:55,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=16 2023-07-12 01:04:55,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=16, state=SUCCESS; OpenRegionProcedure b658a8e97de14ce8106a1feb87599702, server=jenkins-hbase20.apache.org,44505,1689123891229 in 252 msec 2023-07-12 01:04:55,229 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] regionserver.HStore(310): Store=a9225a5a58a47bc81419c3c6486161fd/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,230 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,231 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily31 2023-07-12 01:04:55,231 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily31 2023-07-12 01:04:55,231 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4b65efc1028505129667bcbcaa0e7c9 columnFamilyName colfamily31 2023-07-12 01:04:55,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b658a8e97de14ce8106a1feb87599702, ASSIGN in 478 msec 2023-07-12 01:04:55,232 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(310): Store=c4b65efc1028505129667bcbcaa0e7c9/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:04:55,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fdadbca7962190644ed85497b5875169, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-12 01:04:55,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,246 DEBUG [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily31 2023-07-12 01:04:55,246 DEBUG [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily31 2023-07-12 01:04:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,246 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9225a5a58a47bc81419c3c6486161fd columnFamilyName colfamily31 2023-07-12 01:04:55,247 INFO [StoreOpener-a9225a5a58a47bc81419c3c6486161fd-1] regionserver.HStore(310): Store=a9225a5a58a47bc81419c3c6486161fd/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,248 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,251 DEBUG [StoreOpener-fdadbca7962190644ed85497b5875169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily11 2023-07-12 01:04:55,251 DEBUG [StoreOpener-fdadbca7962190644ed85497b5875169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily11 2023-07-12 01:04:55,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,252 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdadbca7962190644ed85497b5875169 columnFamilyName colfamily11 2023-07-12 01:04:55,253 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] regionserver.HStore(310): Store=fdadbca7962190644ed85497b5875169/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,253 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:04:55,255 DEBUG [StoreOpener-fdadbca7962190644ed85497b5875169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily21 2023-07-12 01:04:55,256 DEBUG [StoreOpener-fdadbca7962190644ed85497b5875169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily21 2023-07-12 01:04:55,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:04:55,256 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdadbca7962190644ed85497b5875169 columnFamilyName colfamily21 2023-07-12 01:04:55,257 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] regionserver.HStore(310): Store=fdadbca7962190644ed85497b5875169/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,257 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,259 DEBUG [StoreOpener-fdadbca7962190644ed85497b5875169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily31 2023-07-12 01:04:55,260 DEBUG [StoreOpener-fdadbca7962190644ed85497b5875169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily31 2023-07-12 01:04:55,260 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdadbca7962190644ed85497b5875169 columnFamilyName colfamily31 2023-07-12 01:04:55,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a9225a5a58a47bc81419c3c6486161fd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64841635, jitterRate=-0.03378434479236603}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c4b65efc1028505129667bcbcaa0e7c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69109094, jitterRate=0.029805749654769897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a9225a5a58a47bc81419c3c6486161fd: 2023-07-12 01:04:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c4b65efc1028505129667bcbcaa0e7c9: 2023-07-12 01:04:55,261 INFO [StoreOpener-fdadbca7962190644ed85497b5875169-1] regionserver.HStore(310): Store=fdadbca7962190644ed85497b5875169/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd., pid=39, masterSystemTime=1689123895078 2023-07-12 01:04:55,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9., pid=45, masterSystemTime=1689123895144 2023-07-12 01:04:55,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:55,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:55,267 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a9225a5a58a47bc81419c3c6486161fd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:04:55,267 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895267"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895267"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895267"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895267"}]},"ts":"1689123895267"} 2023-07-12 01:04:55,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:04:55,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6724d7b4d9c33a2381ae9fe74f47e1f4, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-12 01:04:55,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:04:55,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:04:55,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 120c8b9db387dd5301dffc921c87e0d8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-12 01:04:55,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,270 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fdadbca7962190644ed85497b5875169 2023-07-12 01:04:55,273 DEBUG [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily11 2023-07-12 01:04:55,273 DEBUG [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily11 2023-07-12 01:04:55,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=12 2023-07-12 01:04:55,274 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6724d7b4d9c33a2381ae9fe74f47e1f4 columnFamilyName colfamily11 2023-07-12 01:04:55,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=12, state=SUCCESS; OpenRegionProcedure a9225a5a58a47bc81419c3c6486161fd, server=jenkins-hbase20.apache.org,44505,1689123891229 in 321 msec 2023-07-12 01:04:55,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a9225a5a58a47bc81419c3c6486161fd, ASSIGN in 524 msec 2023-07-12 01:04:55,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895280"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895280"}]},"ts":"1689123895280"} 2023-07-12 01:04:55,283 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,284 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] regionserver.HStore(310): Store=6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,284 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fdadbca7962190644ed85497b5875169; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66866185, jitterRate=-0.0036161988973617554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fdadbca7962190644ed85497b5875169: 2023-07-12 01:04:55,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169., pid=58, masterSystemTime=1689123895202 2023-07-12 01:04:55,286 DEBUG [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily21 2023-07-12 01:04:55,286 DEBUG [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily21 2023-07-12 01:04:55,289 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6724d7b4d9c33a2381ae9fe74f47e1f4 columnFamilyName colfamily21 2023-07-12 01:04:55,288 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily11 2023-07-12 01:04:55,289 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily11 2023-07-12 01:04:55,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=29 2023-07-12 01:04:55,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=29, state=SUCCESS; OpenRegionProcedure c4b65efc1028505129667bcbcaa0e7c9, server=jenkins-hbase20.apache.org,41693,1689123891259 in 291 msec 2023-07-12 01:04:55,290 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c8b9db387dd5301dffc921c87e0d8 columnFamilyName colfamily11 2023-07-12 01:04:55,290 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] regionserver.HStore(310): Store=6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,291 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,291 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(310): Store=120c8b9db387dd5301dffc921c87e0d8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,291 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:04:55,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:04:55,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:04:55,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5dc4f4467bffce1548aaf5c0a32a17ff, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-12 01:04:55,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN in 538 msec 2023-07-12 01:04:55,296 DEBUG [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily31 2023-07-12 01:04:55,296 DEBUG [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily31 2023-07-12 01:04:55,296 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily21 2023-07-12 01:04:55,296 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily21 2023-07-12 01:04:55,296 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=fdadbca7962190644ed85497b5875169, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,297 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895296"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895296"}]},"ts":"1689123895296"} 2023-07-12 01:04:55,297 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6724d7b4d9c33a2381ae9fe74f47e1f4 columnFamilyName colfamily31 2023-07-12 01:04:55,297 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c8b9db387dd5301dffc921c87e0d8 columnFamilyName colfamily21 2023-07-12 01:04:55,298 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,298 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(310): Store=120c8b9db387dd5301dffc921c87e0d8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,298 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,298 INFO [StoreOpener-6724d7b4d9c33a2381ae9fe74f47e1f4-1] regionserver.HStore(310): Store=6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,302 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily31 2023-07-12 01:04:55,302 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily31 2023-07-12 01:04:55,303 DEBUG [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily11 2023-07-12 01:04:55,303 DEBUG [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily11 2023-07-12 01:04:55,303 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c8b9db387dd5301dffc921c87e0d8 columnFamilyName colfamily31 2023-07-12 01:04:55,303 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dc4f4467bffce1548aaf5c0a32a17ff columnFamilyName colfamily11 2023-07-12 01:04:55,304 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(310): Store=120c8b9db387dd5301dffc921c87e0d8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,305 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] regionserver.HStore(310): Store=5dc4f4467bffce1548aaf5c0a32a17ff/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,305 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=25 2023-07-12 01:04:55,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=25, state=SUCCESS; OpenRegionProcedure fdadbca7962190644ed85497b5875169, server=jenkins-hbase20.apache.org,39185,1689123891188 in 225 msec 2023-07-12 01:04:55,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,308 DEBUG [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily21 2023-07-12 01:04:55,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,310 DEBUG [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily21 2023-07-12 01:04:55,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:04:55,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,314 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dc4f4467bffce1548aaf5c0a32a17ff columnFamilyName colfamily21 2023-07-12 01:04:55,315 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] regionserver.HStore(310): Store=5dc4f4467bffce1548aaf5c0a32a17ff/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdadbca7962190644ed85497b5875169, ASSIGN in 557 msec 2023-07-12 01:04:55,316 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:04:55,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6724d7b4d9c33a2381ae9fe74f47e1f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67456650, jitterRate=0.005182415246963501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6724d7b4d9c33a2381ae9fe74f47e1f4: 2023-07-12 01:04:55,324 DEBUG [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily31 2023-07-12 01:04:55,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 120c8b9db387dd5301dffc921c87e0d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61336984, jitterRate=-0.08600771427154541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 120c8b9db387dd5301dffc921c87e0d8: 2023-07-12 01:04:55,324 DEBUG [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily31 2023-07-12 01:04:55,325 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dc4f4467bffce1548aaf5c0a32a17ff columnFamilyName colfamily31 2023-07-12 01:04:55,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4., pid=40, masterSystemTime=1689123895078 2023-07-12 01:04:55,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8., pid=50, masterSystemTime=1689123895144 2023-07-12 01:04:55,326 INFO [StoreOpener-5dc4f4467bffce1548aaf5c0a32a17ff-1] regionserver.HStore(310): Store=5dc4f4467bffce1548aaf5c0a32a17ff/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:04:55,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:04:55,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:04:55,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75325405355a259b4d0cf0a74bbcd911, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-12 01:04:55,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,331 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,331 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895331"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895331"}]},"ts":"1689123895331"} 2023-07-12 01:04:55,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:04:55,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:04:55,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:04:55,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 695e737124e815d7b26e317639623da8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-12 01:04:55,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,336 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,337 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:04:55,340 DEBUG [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily11 2023-07-12 01:04:55,340 DEBUG [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily11 2023-07-12 01:04:55,341 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily11 2023-07-12 01:04:55,341 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily11 2023-07-12 01:04:55,341 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75325405355a259b4d0cf0a74bbcd911 columnFamilyName colfamily11 2023-07-12 01:04:55,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=30 2023-07-12 01:04:55,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=30, state=SUCCESS; OpenRegionProcedure 6724d7b4d9c33a2381ae9fe74f47e1f4, server=jenkins-hbase20.apache.org,44505,1689123891229 in 380 msec 2023-07-12 01:04:55,341 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 695e737124e815d7b26e317639623da8 columnFamilyName colfamily11 2023-07-12 01:04:55,342 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] regionserver.HStore(310): Store=75325405355a259b4d0cf0a74bbcd911/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,342 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,343 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(310): Store=695e737124e815d7b26e317639623da8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,343 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6724d7b4d9c33a2381ae9fe74f47e1f4, ASSIGN in 589 msec 2023-07-12 01:04:55,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,345 DEBUG [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily21 2023-07-12 01:04:55,345 DEBUG [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily21 2023-07-12 01:04:55,346 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily21 2023-07-12 01:04:55,346 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily21 2023-07-12 01:04:55,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5dc4f4467bffce1548aaf5c0a32a17ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62145482, jitterRate=-0.07396015524864197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,346 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75325405355a259b4d0cf0a74bbcd911 columnFamilyName colfamily21 2023-07-12 01:04:55,346 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,346 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 695e737124e815d7b26e317639623da8 columnFamilyName colfamily21 2023-07-12 01:04:55,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5dc4f4467bffce1548aaf5c0a32a17ff: 2023-07-12 01:04:55,346 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689123895346"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895346"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895346"}]},"ts":"1689123895346"} 2023-07-12 01:04:55,347 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] regionserver.HStore(310): Store=75325405355a259b4d0cf0a74bbcd911/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,347 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(310): Store=695e737124e815d7b26e317639623da8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,347 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,348 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff., pid=59, masterSystemTime=1689123895202 2023-07-12 01:04:55,350 DEBUG [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily31 2023-07-12 01:04:55,351 DEBUG [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily31 2023-07-12 01:04:55,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:04:55,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:04:55,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:04:55,351 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily31 2023-07-12 01:04:55,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a009cfd3f7c2b56662acd253b84f912c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c.', STARTKEY => 'yyy', ENDKEY => 'zzz'} 2023-07-12 01:04:55,352 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75325405355a259b4d0cf0a74bbcd911 columnFamilyName colfamily31 2023-07-12 01:04:55,352 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily31 2023-07-12 01:04:55,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,352 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 695e737124e815d7b26e317639623da8 columnFamilyName colfamily31 2023-07-12 01:04:55,353 INFO [StoreOpener-75325405355a259b4d0cf0a74bbcd911-1] regionserver.HStore(310): Store=75325405355a259b4d0cf0a74bbcd911/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,353 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(310): Store=695e737124e815d7b26e317639623da8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=35 2023-07-12 01:04:55,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=35, state=SUCCESS; OpenRegionProcedure 120c8b9db387dd5301dffc921c87e0d8, server=jenkins-hbase20.apache.org,41693,1689123891259 in 324 msec 2023-07-12 01:04:55,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN in 604 msec 2023-07-12 01:04:55,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,360 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,360 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895360"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895360"}]},"ts":"1689123895360"} 2023-07-12 01:04:55,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 695e737124e815d7b26e317639623da8 2023-07-12 01:04:55,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:04:55,365 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,368 DEBUG [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily11 2023-07-12 01:04:55,368 DEBUG [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily11 2023-07-12 01:04:55,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 75325405355a259b4d0cf0a74bbcd911; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62217385, jitterRate=-0.07288871705532074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 75325405355a259b4d0cf0a74bbcd911: 2023-07-12 01:04:55,368 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a009cfd3f7c2b56662acd253b84f912c columnFamilyName colfamily11 2023-07-12 01:04:55,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,369 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] regionserver.HStore(310): Store=a009cfd3f7c2b56662acd253b84f912c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,369 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911., pid=36, masterSystemTime=1689123895078 2023-07-12 01:04:55,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 695e737124e815d7b26e317639623da8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64042731, jitterRate=-0.045688942074775696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 695e737124e815d7b26e317639623da8: 2023-07-12 01:04:55,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=22 2023-07-12 01:04:55,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=22, state=SUCCESS; OpenRegionProcedure 5dc4f4467bffce1548aaf5c0a32a17ff, server=jenkins-hbase20.apache.org,39185,1689123891188 in 282 msec 2023-07-12 01:04:55,371 DEBUG [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily21 2023-07-12 01:04:55,372 DEBUG [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily21 2023-07-12 01:04:55,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:04:55,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:04:55,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:04:55,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e812d33d7edfde6f8072cd607e5557f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2023-07-12 01:04:55,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,373 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a009cfd3f7c2b56662acd253b84f912c columnFamilyName colfamily21 2023-07-12 01:04:55,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8., pid=52, masterSystemTime=1689123895144 2023-07-12 01:04:55,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,374 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=75325405355a259b4d0cf0a74bbcd911, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,374 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895374"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895374"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895374"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895374"}]},"ts":"1689123895374"} 2023-07-12 01:04:55,375 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] regionserver.HStore(310): Store=a009cfd3f7c2b56662acd253b84f912c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,375 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:04:55,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:04:55,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:04:55,377 DEBUG [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily31 2023-07-12 01:04:55,377 DEBUG [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily31 2023-07-12 01:04:55,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 961cbfe10cb28b1216894773e3260869, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-12 01:04:55,378 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a009cfd3f7c2b56662acd253b84f912c columnFamilyName colfamily31 2023-07-12 01:04:55,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,378 INFO [StoreOpener-a009cfd3f7c2b56662acd253b84f912c-1] regionserver.HStore(310): Store=a009cfd3f7c2b56662acd253b84f912c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=13 2023-07-12 01:04:55,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=13, state=SUCCESS; OpenRegionProcedure 75325405355a259b4d0cf0a74bbcd911, server=jenkins-hbase20.apache.org,44505,1689123891229 in 453 msec 2023-07-12 01:04:55,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=75325405355a259b4d0cf0a74bbcd911, ASSIGN in 631 msec 2023-07-12 01:04:55,384 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=695e737124e815d7b26e317639623da8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,384 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895384"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895384"}]},"ts":"1689123895384"} 2023-07-12 01:04:55,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=23 2023-07-12 01:04:55,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=23, state=SUCCESS; OpenRegionProcedure 695e737124e815d7b26e317639623da8, server=jenkins-hbase20.apache.org,41693,1689123891259 in 348 msec 2023-07-12 01:04:55,389 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,391 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN in 638 msec 2023-07-12 01:04:55,392 DEBUG [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily11 2023-07-12 01:04:55,393 DEBUG [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily11 2023-07-12 01:04:55,393 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e812d33d7edfde6f8072cd607e5557f columnFamilyName colfamily11 2023-07-12 01:04:55,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,395 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] regionserver.HStore(310): Store=9e812d33d7edfde6f8072cd607e5557f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,395 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5dc4f4467bffce1548aaf5c0a32a17ff, ASSIGN in 642 msec 2023-07-12 01:04:55,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:04:55,397 DEBUG [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily21 2023-07-12 01:04:55,397 DEBUG [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily21 2023-07-12 01:04:55,398 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e812d33d7edfde6f8072cd607e5557f columnFamilyName colfamily21 2023-07-12 01:04:55,399 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] regionserver.HStore(310): Store=9e812d33d7edfde6f8072cd607e5557f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,399 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,400 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily11 2023-07-12 01:04:55,400 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily11 2023-07-12 01:04:55,401 DEBUG [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily31 2023-07-12 01:04:55,401 DEBUG [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily31 2023-07-12 01:04:55,401 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961cbfe10cb28b1216894773e3260869 columnFamilyName colfamily11 2023-07-12 01:04:55,401 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e812d33d7edfde6f8072cd607e5557f columnFamilyName colfamily31 2023-07-12 01:04:55,402 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(310): Store=961cbfe10cb28b1216894773e3260869/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,402 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,402 INFO [StoreOpener-9e812d33d7edfde6f8072cd607e5557f-1] regionserver.HStore(310): Store=9e812d33d7edfde6f8072cd607e5557f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,404 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily21 2023-07-12 01:04:55,405 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily21 2023-07-12 01:04:55,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a009cfd3f7c2b56662acd253b84f912c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60452668, jitterRate=-0.099185049533844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,405 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961cbfe10cb28b1216894773e3260869 columnFamilyName colfamily21 2023-07-12 01:04:55,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a009cfd3f7c2b56662acd253b84f912c: 2023-07-12 01:04:55,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c., pid=55, masterSystemTime=1689123895202 2023-07-12 01:04:55,406 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(310): Store=961cbfe10cb28b1216894773e3260869/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,407 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:04:55,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:04:55,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:04:55,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fa622b2d252cd13cd3d1492a2b2abf7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-12 01:04:55,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,410 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily31 2023-07-12 01:04:55,410 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily31 2023-07-12 01:04:55,411 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=a009cfd3f7c2b56662acd253b84f912c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,411 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895411"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895411"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895411"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895411"}]},"ts":"1689123895411"} 2023-07-12 01:04:55,411 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961cbfe10cb28b1216894773e3260869 columnFamilyName colfamily31 2023-07-12 01:04:55,414 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,414 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(310): Store=961cbfe10cb28b1216894773e3260869/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:04:55,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,421 DEBUG [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily11 2023-07-12 01:04:55,421 DEBUG [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily11 2023-07-12 01:04:55,421 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fa622b2d252cd13cd3d1492a2b2abf7 columnFamilyName colfamily11 2023-07-12 01:04:55,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,422 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] regionserver.HStore(310): Store=6fa622b2d252cd13cd3d1492a2b2abf7/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=34 2023-07-12 01:04:55,423 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=34, state=SUCCESS; OpenRegionProcedure a009cfd3f7c2b56662acd253b84f912c, server=jenkins-hbase20.apache.org,39185,1689123891188 in 354 msec 2023-07-12 01:04:55,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9e812d33d7edfde6f8072cd607e5557f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70258601, jitterRate=0.046934738755226135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9e812d33d7edfde6f8072cd607e5557f: 2023-07-12 01:04:55,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f., pid=37, masterSystemTime=1689123895078 2023-07-12 01:04:55,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,424 DEBUG [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily21 2023-07-12 01:04:55,424 DEBUG [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily21 2023-07-12 01:04:55,425 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fa622b2d252cd13cd3d1492a2b2abf7 columnFamilyName colfamily21 2023-07-12 01:04:55,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a009cfd3f7c2b56662acd253b84f912c, ASSIGN in 671 msec 2023-07-12 01:04:55,426 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] regionserver.HStore(310): Store=6fa622b2d252cd13cd3d1492a2b2abf7/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,426 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 961cbfe10cb28b1216894773e3260869 2023-07-12 01:04:55,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:04:55,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:04:55,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:04:55,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 594b8a8fea092d1d008b127b6f92abca, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-12 01:04:55,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,428 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=9e812d33d7edfde6f8072cd607e5557f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,429 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895428"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895428"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895428"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895428"}]},"ts":"1689123895428"} 2023-07-12 01:04:55,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,431 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,431 DEBUG [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily31 2023-07-12 01:04:55,432 DEBUG [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily31 2023-07-12 01:04:55,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 961cbfe10cb28b1216894773e3260869; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74555538, jitterRate=0.1109640896320343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 961cbfe10cb28b1216894773e3260869: 2023-07-12 01:04:55,432 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fa622b2d252cd13cd3d1492a2b2abf7 columnFamilyName colfamily31 2023-07-12 01:04:55,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869., pid=51, masterSystemTime=1689123895144 2023-07-12 01:04:55,434 DEBUG [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily11 2023-07-12 01:04:55,435 DEBUG [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily11 2023-07-12 01:04:55,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:04:55,436 INFO [StoreOpener-6fa622b2d252cd13cd3d1492a2b2abf7-1] regionserver.HStore(310): Store=6fa622b2d252cd13cd3d1492a2b2abf7/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:04:55,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:04:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8578d7595773e9fb4bf660e4e4d3ef2, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-12 01:04:55,437 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 594b8a8fea092d1d008b127b6f92abca columnFamilyName colfamily11 2023-07-12 01:04:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=27 2023-07-12 01:04:55,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=27, state=SUCCESS; OpenRegionProcedure 9e812d33d7edfde6f8072cd607e5557f, server=jenkins-hbase20.apache.org,44505,1689123891229 in 498 msec 2023-07-12 01:04:55,439 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] regionserver.HStore(310): Store=594b8a8fea092d1d008b127b6f92abca/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,439 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,441 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,441 DEBUG [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily21 2023-07-12 01:04:55,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e812d33d7edfde6f8072cd607e5557f, ASSIGN in 689 msec 2023-07-12 01:04:55,441 DEBUG [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily21 2023-07-12 01:04:55,441 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 594b8a8fea092d1d008b127b6f92abca columnFamilyName colfamily21 2023-07-12 01:04:55,442 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] regionserver.HStore(310): Store=594b8a8fea092d1d008b127b6f92abca/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,442 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,443 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11 2023-07-12 01:04:55,443 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11 2023-07-12 01:04:55,443 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8578d7595773e9fb4bf660e4e4d3ef2 columnFamilyName colfamily11 2023-07-12 01:04:55,443 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=961cbfe10cb28b1216894773e3260869, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,444 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895443"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895443"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895443"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895443"}]},"ts":"1689123895443"} 2023-07-12 01:04:55,444 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(310): Store=f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,444 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:04:55,445 DEBUG [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily31 2023-07-12 01:04:55,445 DEBUG [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily31 2023-07-12 01:04:55,446 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 594b8a8fea092d1d008b127b6f92abca columnFamilyName colfamily31 2023-07-12 01:04:55,447 INFO [StoreOpener-594b8a8fea092d1d008b127b6f92abca-1] regionserver.HStore(310): Store=594b8a8fea092d1d008b127b6f92abca/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,450 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily21 2023-07-12 01:04:55,450 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily21 2023-07-12 01:04:55,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6fa622b2d252cd13cd3d1492a2b2abf7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70620750, jitterRate=0.05233117938041687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6fa622b2d252cd13cd3d1492a2b2abf7: 2023-07-12 01:04:55,451 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8578d7595773e9fb4bf660e4e4d3ef2 columnFamilyName colfamily21 2023-07-12 01:04:55,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7., pid=53, masterSystemTime=1689123895202 2023-07-12 01:04:55,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=32 2023-07-12 01:04:55,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=32, state=SUCCESS; OpenRegionProcedure 961cbfe10cb28b1216894773e3260869, server=jenkins-hbase20.apache.org,41693,1689123891259 in 414 msec 2023-07-12 01:04:55,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN in 700 msec 2023-07-12 01:04:55,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:04:55,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:04:55,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:55,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca889399af08ba65a850adb2ee8395d6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-12 01:04:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,457 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,457 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895457"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895457"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895457"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895457"}]},"ts":"1689123895457"} 2023-07-12 01:04:55,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:04:55,460 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,462 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(310): Store=f8578d7595773e9fb4bf660e4e4d3ef2/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,463 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,463 DEBUG [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily11 2023-07-12 01:04:55,463 DEBUG [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily11 2023-07-12 01:04:55,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=19 2023-07-12 01:04:55,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=19, state=SUCCESS; OpenRegionProcedure 6fa622b2d252cd13cd3d1492a2b2abf7, server=jenkins-hbase20.apache.org,39185,1689123891188 in 413 msec 2023-07-12 01:04:55,464 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca889399af08ba65a850adb2ee8395d6 columnFamilyName colfamily11 2023-07-12 01:04:55,465 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] regionserver.HStore(310): Store=ca889399af08ba65a850adb2ee8395d6/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,465 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fa622b2d252cd13cd3d1492a2b2abf7, ASSIGN in 714 msec 2023-07-12 01:04:55,467 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily31 2023-07-12 01:04:55,467 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily31 2023-07-12 01:04:55,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,468 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8578d7595773e9fb4bf660e4e4d3ef2 columnFamilyName colfamily31 2023-07-12 01:04:55,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 594b8a8fea092d1d008b127b6f92abca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69529602, jitterRate=0.03607180714607239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 594b8a8fea092d1d008b127b6f92abca: 2023-07-12 01:04:55,469 DEBUG [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily21 2023-07-12 01:04:55,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca., pid=43, masterSystemTime=1689123895078 2023-07-12 01:04:55,469 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(310): Store=f8578d7595773e9fb4bf660e4e4d3ef2/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,469 DEBUG [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily21 2023-07-12 01:04:55,470 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca889399af08ba65a850adb2ee8395d6 columnFamilyName colfamily21 2023-07-12 01:04:55,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,471 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] regionserver.HStore(310): Store=ca889399af08ba65a850adb2ee8395d6/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,472 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:04:55,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:04:55,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:04:55,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e82c5c0900eccdfd36d246bfd483cc8b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2023-07-12 01:04:55,474 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=594b8a8fea092d1d008b127b6f92abca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,475 DEBUG [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily31 2023-07-12 01:04:55,475 DEBUG [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily31 2023-07-12 01:04:55,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,474 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895474"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895474"}]},"ts":"1689123895474"} 2023-07-12 01:04:55,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,476 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca889399af08ba65a850adb2ee8395d6 columnFamilyName colfamily31 2023-07-12 01:04:55,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,477 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:04:55,480 DEBUG [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily11 2023-07-12 01:04:55,480 DEBUG [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily11 2023-07-12 01:04:55,480 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e82c5c0900eccdfd36d246bfd483cc8b columnFamilyName colfamily11 2023-07-12 01:04:55,482 INFO [StoreOpener-ca889399af08ba65a850adb2ee8395d6-1] regionserver.HStore(310): Store=ca889399af08ba65a850adb2ee8395d6/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,482 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] regionserver.HStore(310): Store=e82c5c0900eccdfd36d246bfd483cc8b/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,483 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-07-12 01:04:55,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; OpenRegionProcedure 594b8a8fea092d1d008b127b6f92abca, server=jenkins-hbase20.apache.org,44505,1689123891229 in 500 msec 2023-07-12 01:04:55,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f8578d7595773e9fb4bf660e4e4d3ef2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74843915, jitterRate=0.11526124179363251}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f8578d7595773e9fb4bf660e4e4d3ef2: 2023-07-12 01:04:55,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2., pid=47, masterSystemTime=1689123895144 2023-07-12 01:04:55,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=594b8a8fea092d1d008b127b6f92abca, ASSIGN in 732 msec 2023-07-12 01:04:55,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:04:55,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:04:55,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:04:55,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4286f94dc74b552274bbaef598de52f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-12 01:04:55,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,490 DEBUG [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily21 2023-07-12 01:04:55,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,490 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,490 DEBUG [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily21 2023-07-12 01:04:55,492 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895490"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895490"}]},"ts":"1689123895490"} 2023-07-12 01:04:55,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:04:55,493 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e82c5c0900eccdfd36d246bfd483cc8b columnFamilyName colfamily21 2023-07-12 01:04:55,493 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] regionserver.HStore(310): Store=e82c5c0900eccdfd36d246bfd483cc8b/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,494 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,495 DEBUG [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily31 2023-07-12 01:04:55,495 DEBUG [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily31 2023-07-12 01:04:55,496 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e82c5c0900eccdfd36d246bfd483cc8b columnFamilyName colfamily31 2023-07-12 01:04:55,497 INFO [StoreOpener-e82c5c0900eccdfd36d246bfd483cc8b-1] regionserver.HStore(310): Store=e82c5c0900eccdfd36d246bfd483cc8b/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=26 2023-07-12 01:04:55,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=26, state=SUCCESS; OpenRegionProcedure f8578d7595773e9fb4bf660e4e4d3ef2, server=jenkins-hbase20.apache.org,41693,1689123891259 in 489 msec 2023-07-12 01:04:55,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN in 749 msec 2023-07-12 01:04:55,503 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:04:55,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ca889399af08ba65a850adb2ee8395d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64390906, jitterRate=-0.04050073027610779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ca889399af08ba65a850adb2ee8395d6: 2023-07-12 01:04:55,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e82c5c0900eccdfd36d246bfd483cc8b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63770933, jitterRate=-0.0497390478849411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e82c5c0900eccdfd36d246bfd483cc8b: 2023-07-12 01:04:55,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6., pid=54, masterSystemTime=1689123895202 2023-07-12 01:04:55,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b., pid=38, masterSystemTime=1689123895078 2023-07-12 01:04:55,521 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily11 2023-07-12 01:04:55,521 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily11 2023-07-12 01:04:55,522 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4286f94dc74b552274bbaef598de52f columnFamilyName colfamily11 2023-07-12 01:04:55,523 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(310): Store=a4286f94dc74b552274bbaef598de52f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:04:55,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:04:55,524 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,524 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:55,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:55,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:55,524 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895524"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895524"}]},"ts":"1689123895524"} 2023-07-12 01:04:55,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:04:55,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a85da1c5071914c49b60e5af919979f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2023-07-12 01:04:55,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,526 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily21 2023-07-12 01:04:55,526 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily21 2023-07-12 01:04:55,527 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,527 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4286f94dc74b552274bbaef598de52f columnFamilyName colfamily21 2023-07-12 01:04:55,528 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(310): Store=a4286f94dc74b552274bbaef598de52f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,528 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,529 DEBUG [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily11 2023-07-12 01:04:55,529 DEBUG [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily11 2023-07-12 01:04:55,530 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a85da1c5071914c49b60e5af919979f columnFamilyName colfamily11 2023-07-12 01:04:55,531 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily31 2023-07-12 01:04:55,531 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily31 2023-07-12 01:04:55,531 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] regionserver.HStore(310): Store=1a85da1c5071914c49b60e5af919979f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,531 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4286f94dc74b552274bbaef598de52f columnFamilyName colfamily31 2023-07-12 01:04:55,532 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=24 2023-07-12 01:04:55,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=24, state=SUCCESS; OpenRegionProcedure e82c5c0900eccdfd36d246bfd483cc8b, server=jenkins-hbase20.apache.org,44505,1689123891229 in 586 msec 2023-07-12 01:04:55,532 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(310): Store=a4286f94dc74b552274bbaef598de52f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,535 DEBUG [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily21 2023-07-12 01:04:55,536 DEBUG [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily21 2023-07-12 01:04:55,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e82c5c0900eccdfd36d246bfd483cc8b, ASSIGN in 782 msec 2023-07-12 01:04:55,537 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a85da1c5071914c49b60e5af919979f columnFamilyName colfamily21 2023-07-12 01:04:55,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ca889399af08ba65a850adb2ee8395d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689123895538"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895538"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895538"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895538"}]},"ts":"1689123895538"} 2023-07-12 01:04:55,540 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] regionserver.HStore(310): Store=1a85da1c5071914c49b60e5af919979f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,540 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a4286f94dc74b552274bbaef598de52f 2023-07-12 01:04:55,543 DEBUG [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily31 2023-07-12 01:04:55,544 DEBUG [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily31 2023-07-12 01:04:55,545 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a85da1c5071914c49b60e5af919979f columnFamilyName colfamily31 2023-07-12 01:04:55,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=10 2023-07-12 01:04:55,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=10, state=SUCCESS; OpenRegionProcedure ca889399af08ba65a850adb2ee8395d6, server=jenkins-hbase20.apache.org,39185,1689123891188 in 486 msec 2023-07-12 01:04:55,546 INFO [StoreOpener-1a85da1c5071914c49b60e5af919979f-1] regionserver.HStore(310): Store=1a85da1c5071914c49b60e5af919979f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca889399af08ba65a850adb2ee8395d6, ASSIGN in 795 msec 2023-07-12 01:04:55,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a4286f94dc74b552274bbaef598de52f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70921394, jitterRate=0.056811124086380005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a4286f94dc74b552274bbaef598de52f: 2023-07-12 01:04:55,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f., pid=48, masterSystemTime=1689123895144 2023-07-12 01:04:55,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:04:55,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:04:55,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:04:55,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 488292cb0f12944b5c0dae2af2ac0634, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-12 01:04:55,554 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895554"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895554"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895554"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895554"}]},"ts":"1689123895554"} 2023-07-12 01:04:55,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:04:55,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,556 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,559 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily11 2023-07-12 01:04:55,559 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily11 2023-07-12 01:04:55,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1a85da1c5071914c49b60e5af919979f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74663199, jitterRate=0.11256836354732513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,560 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 488292cb0f12944b5c0dae2af2ac0634 columnFamilyName colfamily11 2023-07-12 01:04:55,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1a85da1c5071914c49b60e5af919979f: 2023-07-12 01:04:55,561 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(310): Store=488292cb0f12944b5c0dae2af2ac0634/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f., pid=56, masterSystemTime=1689123895202 2023-07-12 01:04:55,561 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=14 2023-07-12 01:04:55,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=14, state=SUCCESS; OpenRegionProcedure a4286f94dc74b552274bbaef598de52f, server=jenkins-hbase20.apache.org,41693,1689123891259 in 546 msec 2023-07-12 01:04:55,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:04:55,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:04:55,564 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily21 2023-07-12 01:04:55,564 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily21 2023-07-12 01:04:55,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:04:55,564 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1a85da1c5071914c49b60e5af919979f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 840da36b068ca121abcf9b125401ce01, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-12 01:04:55,565 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 488292cb0f12944b5c0dae2af2ac0634 columnFamilyName colfamily21 2023-07-12 01:04:55,565 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895564"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895564"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895564"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895564"}]},"ts":"1689123895564"} 2023-07-12 01:04:55,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,566 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(310): Store=488292cb0f12944b5c0dae2af2ac0634/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,567 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,569 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,570 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily31 2023-07-12 01:04:55,570 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily31 2023-07-12 01:04:55,571 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 488292cb0f12944b5c0dae2af2ac0634 columnFamilyName colfamily31 2023-07-12 01:04:55,572 DEBUG [StoreOpener-840da36b068ca121abcf9b125401ce01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily11 2023-07-12 01:04:55,572 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(310): Store=488292cb0f12944b5c0dae2af2ac0634/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,572 DEBUG [StoreOpener-840da36b068ca121abcf9b125401ce01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily11 2023-07-12 01:04:55,572 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 840da36b068ca121abcf9b125401ce01 columnFamilyName colfamily11 2023-07-12 01:04:55,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=15 2023-07-12 01:04:55,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=15, state=SUCCESS; OpenRegionProcedure 1a85da1c5071914c49b60e5af919979f, server=jenkins-hbase20.apache.org,39185,1689123891188 in 503 msec 2023-07-12 01:04:55,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,573 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] regionserver.HStore(310): Store=840da36b068ca121abcf9b125401ce01/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,574 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,575 DEBUG [StoreOpener-840da36b068ca121abcf9b125401ce01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily21 2023-07-12 01:04:55,576 DEBUG [StoreOpener-840da36b068ca121abcf9b125401ce01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily21 2023-07-12 01:04:55,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,576 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 840da36b068ca121abcf9b125401ce01 columnFamilyName colfamily21 2023-07-12 01:04:55,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1a85da1c5071914c49b60e5af919979f, ASSIGN in 823 msec 2023-07-12 01:04:55,577 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] regionserver.HStore(310): Store=840da36b068ca121abcf9b125401ce01/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,577 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:04:55,579 DEBUG [StoreOpener-840da36b068ca121abcf9b125401ce01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily31 2023-07-12 01:04:55,580 DEBUG [StoreOpener-840da36b068ca121abcf9b125401ce01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily31 2023-07-12 01:04:55,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN in 826 msec 2023-07-12 01:04:55,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,581 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 840da36b068ca121abcf9b125401ce01 columnFamilyName colfamily31 2023-07-12 01:04:55,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 488292cb0f12944b5c0dae2af2ac0634; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70985278, jitterRate=0.05776306986808777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 488292cb0f12944b5c0dae2af2ac0634: 2023-07-12 01:04:55,581 INFO [StoreOpener-840da36b068ca121abcf9b125401ce01-1] regionserver.HStore(310): Store=840da36b068ca121abcf9b125401ce01/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634., pid=49, masterSystemTime=1689123895144 2023-07-12 01:04:55,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:04:55,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:04:55,586 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:55,586 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895586"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895586"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895586"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895586"}]},"ts":"1689123895586"} 2023-07-12 01:04:55,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 840da36b068ca121abcf9b125401ce01 2023-07-12 01:04:55,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 840da36b068ca121abcf9b125401ce01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73696924, jitterRate=0.09816974401473999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 840da36b068ca121abcf9b125401ce01: 2023-07-12 01:04:55,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=20 2023-07-12 01:04:55,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01., pid=57, masterSystemTime=1689123895202 2023-07-12 01:04:55,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=20, state=SUCCESS; OpenRegionProcedure 488292cb0f12944b5c0dae2af2ac0634, server=jenkins-hbase20.apache.org,41693,1689123891259 in 570 msec 2023-07-12 01:04:55,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN in 843 msec 2023-07-12 01:04:55,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:04:55,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:04:55,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:04:55,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=840da36b068ca121abcf9b125401ce01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4387a308fe1e2027fcba9289c9f7579e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e.', STARTKEY => 'vvv', ENDKEY => 'www'} 2023-07-12 01:04:55,596 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895595"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895595"}]},"ts":"1689123895595"} 2023-07-12 01:04:55,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,598 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,600 DEBUG [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily11 2023-07-12 01:04:55,600 DEBUG [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily11 2023-07-12 01:04:55,601 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4387a308fe1e2027fcba9289c9f7579e columnFamilyName colfamily11 2023-07-12 01:04:55,602 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] regionserver.HStore(310): Store=4387a308fe1e2027fcba9289c9f7579e/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=18 2023-07-12 01:04:55,602 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=18, state=SUCCESS; OpenRegionProcedure 840da36b068ca121abcf9b125401ce01, server=jenkins-hbase20.apache.org,39185,1689123891188 in 527 msec 2023-07-12 01:04:55,604 DEBUG [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily21 2023-07-12 01:04:55,604 DEBUG [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily21 2023-07-12 01:04:55,604 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4387a308fe1e2027fcba9289c9f7579e columnFamilyName colfamily21 2023-07-12 01:04:55,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=840da36b068ca121abcf9b125401ce01, ASSIGN in 852 msec 2023-07-12 01:04:55,605 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] regionserver.HStore(310): Store=4387a308fe1e2027fcba9289c9f7579e/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,605 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,607 DEBUG [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily31 2023-07-12 01:04:55,607 DEBUG [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily31 2023-07-12 01:04:55,607 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4387a308fe1e2027fcba9289c9f7579e columnFamilyName colfamily31 2023-07-12 01:04:55,608 INFO [StoreOpener-4387a308fe1e2027fcba9289c9f7579e-1] regionserver.HStore(310): Store=4387a308fe1e2027fcba9289c9f7579e/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:04:55,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4387a308fe1e2027fcba9289c9f7579e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70758159, jitterRate=0.05437873303890228}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4387a308fe1e2027fcba9289c9f7579e: 2023-07-12 01:04:55,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e., pid=60, masterSystemTime=1689123895202 2023-07-12 01:04:55,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:04:55,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:04:55,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:04:55,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 863b75dea6bb4708953712d4bdadae9b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-12 01:04:55,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:04:55,623 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=4387a308fe1e2027fcba9289c9f7579e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,623 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895623"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895623"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895623"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895623"}]},"ts":"1689123895623"} 2023-07-12 01:04:55,625 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,627 DEBUG [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily11 2023-07-12 01:04:55,628 DEBUG [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily11 2023-07-12 01:04:55,628 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 863b75dea6bb4708953712d4bdadae9b columnFamilyName colfamily11 2023-07-12 01:04:55,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=31 2023-07-12 01:04:55,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=31, state=SUCCESS; OpenRegionProcedure 4387a308fe1e2027fcba9289c9f7579e, server=jenkins-hbase20.apache.org,39185,1689123891188 in 538 msec 2023-07-12 01:04:55,629 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] regionserver.HStore(310): Store=863b75dea6bb4708953712d4bdadae9b/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,629 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4387a308fe1e2027fcba9289c9f7579e, ASSIGN in 877 msec 2023-07-12 01:04:55,631 DEBUG [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily21 2023-07-12 01:04:55,631 DEBUG [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily21 2023-07-12 01:04:55,631 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 863b75dea6bb4708953712d4bdadae9b columnFamilyName colfamily21 2023-07-12 01:04:55,633 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] regionserver.HStore(310): Store=863b75dea6bb4708953712d4bdadae9b/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,633 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,634 DEBUG [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily31 2023-07-12 01:04:55,634 DEBUG [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily31 2023-07-12 01:04:55,635 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 863b75dea6bb4708953712d4bdadae9b columnFamilyName colfamily31 2023-07-12 01:04:55,636 INFO [StoreOpener-863b75dea6bb4708953712d4bdadae9b-1] regionserver.HStore(310): Store=863b75dea6bb4708953712d4bdadae9b/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:04:55,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:04:55,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:04:55,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 01:04:55,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 863b75dea6bb4708953712d4bdadae9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71717632, jitterRate=0.06867599487304688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:04:55,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 863b75dea6bb4708953712d4bdadae9b: 2023-07-12 01:04:55,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b., pid=61, masterSystemTime=1689123895202 2023-07-12 01:04:55,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:04:55,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:04:55,653 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=863b75dea6bb4708953712d4bdadae9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:55,653 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689123895653"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689123895653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689123895653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689123895653"}]},"ts":"1689123895653"} 2023-07-12 01:04:55,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=28 2023-07-12 01:04:55,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=28, state=SUCCESS; OpenRegionProcedure 863b75dea6bb4708953712d4bdadae9b, server=jenkins-hbase20.apache.org,39185,1689123891188 in 560 msec 2023-07-12 01:04:55,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=9 2023-07-12 01:04:55,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=863b75dea6bb4708953712d4bdadae9b, ASSIGN in 906 msec 2023-07-12 01:04:55,663 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 01:04:55,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689123895663"}]},"ts":"1689123895663"} 2023-07-12 01:04:55,665 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLED in hbase:meta 2023-07-12 01:04:55,668 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 01:04:55,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true in 1.6140 sec 2023-07-12 01:04:56,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 01:04:56,192 INFO [Listener at localhost.localdomain/45615] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, procId: 9 completed 2023-07-12 01:04:56,192 DEBUG [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true get assigned. Timeout = 60000ms 2023-07-12 01:04:56,194 INFO [Listener at localhost.localdomain/45615] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 01:04:56,199 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41693] regionserver.StoreScanner(1093): Switch to stream read (scanned=32976 bytes) of info 2023-07-12 01:04:56,214 INFO [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(3484): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned to meta. Checking AM states. 2023-07-12 01:04:56,214 INFO [Listener at localhost.localdomain/45615] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 01:04:56,215 INFO [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(3504): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned. 2023-07-12 01:04:56,388 DEBUG [hconnection-0x225bbd80-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 01:04:56,389 DEBUG [hconnection-0x225bbd80-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 01:04:56,409 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:04:56,415 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:04:56,430 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44505] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//148.251.75.209 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:04:56,433 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39185] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//148.251.75.209 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:04:56,601 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 01:04:56,614 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 01:04:56,621 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 01:04:56,629 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 01:04:56,637 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 01:04:56,643 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 01:04:56,650 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 01:04:56,657 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 01:04:56,663 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 01:04:56,670 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 01:04:56,676 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 01:04:56,683 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 01:04:56,690 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 01:04:56,696 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 01:04:56,702 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 01:04:56,707 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 01:04:56,714 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 01:04:56,718 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 01:04:56,723 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 01:04:56,729 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 01:04:56,733 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 01:04:56,738 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 01:04:56,744 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 01:04:56,748 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 01:04:56,753 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 01:04:56,762 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 01:04:56,767 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 01:04:56,771 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 01:04:56,776 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 01:04:56,781 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 01:04:56,786 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 01:04:56,791 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 01:04:56,797 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 01:04:56,802 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 01:04:56,807 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 01:04:56,811 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 01:04:56,816 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 01:04:56,821 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 01:04:56,824 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 01:04:56,830 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 01:04:56,835 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 01:04:56,839 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 01:04:56,842 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 01:04:56,847 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 01:04:56,850 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 01:04:56,853 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 01:04:56,857 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 01:04:56,861 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 01:04:56,864 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 01:04:56,868 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 01:04:57,140 WARN [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: true 2023-07-12 01:04:57,140 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentTestingUtil(82): KILL REGION SERVER jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:57,140 INFO [Listener at localhost.localdomain/45615] hbase.MiniHBaseCluster(271): Killing jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:57,143 ERROR [Listener at localhost.localdomain/45615] helpers.MarkerIgnoringBase(143): ***** ABORTING region server jenkins-hbase20.apache.org,41693,1689123891259: Simulated kill ***** 2023-07-12 01:04:57,144 ERROR [Listener at localhost.localdomain/45615] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-12 01:04:57,146 DEBUG [Listener at localhost.localdomain/45615] util.JSONBean(130): Listing beans for java.lang:type=Memory 2023-07-12 01:04:57,149 DEBUG [Listener at localhost.localdomain/45615] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=IPC 2023-07-12 01:04:57,150 DEBUG [Listener at localhost.localdomain/45615] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Replication 2023-07-12 01:04:57,151 DEBUG [Listener at localhost.localdomain/45615] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Server 2023-07-12 01:04:57,151 INFO [Listener at localhost.localdomain/45615] regionserver.HRegionServer(2557): Dump of metrics as JSON on abort: { "beans": [ { "name": "java.lang:type=Memory", "modelerType": "sun.management.MemoryImpl", "Verbose": false, "ObjectPendingFinalizationCount": 0, "HeapMemoryUsage": { "committed": 1015021568, "init": 524288000, "max": 2051014656, "used": 402779160 }, "NonHeapMemoryUsage": { "committed": 127991808, "init": 2555904, "max": -1, "used": 125718760 }, "ObjectName": "java.lang:type=Memory" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType": "RegionServer,sub=IPC", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase20.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType": "RegionServer,sub=Replication", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase20.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType": "RegionServer,sub=Server", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase20.apache.org" } ] } 2023-07-12 01:04:57,155 WARN [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37493] master.MasterRpcServices(612): jenkins-hbase20.apache.org,41693,1689123891259 reported a fatal error: ***** ABORTING region server jenkins-hbase20.apache.org,41693,1689123891259: Simulated kill ***** 2023-07-12 01:04:57,157 INFO [Listener at localhost.localdomain/45615] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41693,1689123891259' ***** 2023-07-12 01:04:57,157 INFO [Listener at localhost.localdomain/45615] regionserver.HRegionServer(2311): STOPPED: Simulated kill 2023-07-12 01:04:57,157 INFO [RS:2;jenkins-hbase20:41693] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 01:04:57,158 INFO [Listener at localhost.localdomain/45615] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 01:04:57,158 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 01:04:57,158 INFO [RS:2;jenkins-hbase20:41693] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager abruptly. 2023-07-12 01:04:57,159 INFO [RS:2;jenkins-hbase20:41693] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager abruptly. 2023-07-12 01:04:57,159 DEBUG [RS:2;jenkins-hbase20:41693] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d6e30c1 to 127.0.0.1:57181 2023-07-12 01:04:57,159 DEBUG [RS:2;jenkins-hbase20:41693] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:04:57,174 DEBUG [RS:2;jenkins-hbase20:41693] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:04:57,175 INFO [RS:2;jenkins-hbase20:41693] regionserver.LeaseManager(133): Closed leases 2023-07-12 01:04:57,176 INFO [RS:2;jenkins-hbase20:41693] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41693 2023-07-12 01:04:57,185 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:57,185 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:57,186 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 2023-07-12 01:04:57,186 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:04:57,186 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:04:57,185 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:04:57,186 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:04:57,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:57,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:57,188 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41693,1689123891259] 2023-07-12 01:04:57,188 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41693,1689123891259; numProcessing=1 2023-07-12 01:04:57,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:57,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:57,189 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 znode expired, triggering replicatorRemoved event 2023-07-12 01:04:57,189 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase20.apache.org,41693,1689123891259 znode expired, triggering replicatorRemoved event 2023-07-12 01:04:57,203 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 01:04:57,288 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:04:57,289 INFO [RS:2;jenkins-hbase20:41693] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41693,1689123891259; zookeeper connection closed. 2023-07-12 01:04:57,289 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:41693-0x1007eb59db80003, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:04:57,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@27fe7ab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@27fe7ab 2023-07-12 01:04:57,291 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41693,1689123891259 already deleted, retry=false 2023-07-12 01:04:57,292 INFO [RegionServerTracker-0] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,41693,1689123891259 on jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:04:57,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:57,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:04:57,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:57,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:04:57,298 DEBUG [RegionServerTracker-0] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:04:57,299 INFO [RegionServerTracker-0] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=62 for jenkins-hbase20.apache.org,41693,1689123891259 (carryingMeta=true) jenkins-hbase20.apache.org,41693,1689123891259/CRASHED/regionCount=9/lock=java.util.concurrent.locks.ReentrantReadWriteLock@146d546c[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 01:04:57,300 INFO [Listener at localhost.localdomain/45615] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 01:04:57,302 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:04:57,302 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:04:57,302 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:04:57,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:04:57,303 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:04:57,304 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 0 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:04:57,305 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:04:57,305 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:04:57,306 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:04:57,308 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-12 01:04:57,309 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:04:57,309 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:04:57,309 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:04:57,309 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:04:57,310 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 01:04:57,314 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[] 2023-07-12 01:04:57,316 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:04:57,317 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:04:57,317 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:04:57,318 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:04:57,319 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:04:57,320 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:04:57,320 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:04:57,321 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 10 msec 2023-07-12 01:04:57,323 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:04:57,324 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,41693,1689123891259, table=hbase:meta, region=1588230740 2023-07-12 01:04:57,326 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689123927326 2023-07-12 01:04:57,327 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:04:57,327 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:04:57,327 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:04:57,333 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true, isMeta: true 2023-07-12 01:04:57,334 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:04:57,335 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:04:57,335 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting 2023-07-12 01:04:57,338 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=1, meta=true 2023-07-12 01:04:57,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta}] 2023-07-12 01:04:57,341 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:04:57,341 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:04:57,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:04:57,342 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:04:57,442 DEBUG [hconnection-0x4d656f2b-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:04:57,575 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 01:04:57,575 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 01:04:57,644 DEBUG [hconnection-0x4d656f2b-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:04:57,948 DEBUG [hconnection-0x4d656f2b-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:04:58,450 DEBUG [hconnection-0x4d656f2b-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:04:58,486 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 01:04:58,560 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true' 2023-07-12 01:04:58,561 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 01:04:58,563 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 01:04:59,460 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:04:59,461 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:00,377 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 01:05:00,378 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 01:05:01,464 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:01,465 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:01,465 DEBUG [hconnection-0x4d656f2b-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4132 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:05,507 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:05,508 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:05,508 DEBUG [hconnection-0x4d656f2b-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8175 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:15,565 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:15,566 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:15,567 DEBUG [hconnection-0x4d656f2b-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18233 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:25,634 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:25,635 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:25,635 DEBUG [hconnection-0x4d656f2b-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28302 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:35,723 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:35,724 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:35,724 DEBUG [hconnection-0x4d656f2b-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38391 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:44,090 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase20.apache.org,41693,1689123891259 already deleted, retry=false 2023-07-12 01:05:44,957 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase20.apache.org,41693,1689123891259 already deleted, retry=false 2023-07-12 01:05:45,788 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:45,791 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:45,791 DEBUG [hconnection-0x4d656f2b-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48458 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:45,793 DEBUG [Listener at localhost.localdomain/45615] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68463: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68463: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:45,795 WARN [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T01:05:45.794Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68463: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68463: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:45,796 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 1 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:05:45,796 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:05:45,796 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:05:45,797 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:05:45,797 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:05:45,797 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:05:45,797 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:05:45,797 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:05:45,797 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:05:45,800 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 3 msec 2023-07-12 01:05:45,802 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0] 2023-07-12 01:05:45,803 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:05:45,803 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:05:45,804 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:05:45,804 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:05:45,805 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:05:45,805 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:05:45,805 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:05:45,805 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-07-12 01:05:45,806 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:05:45,807 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,41693,1689123891259, table=hbase:meta, region=1588230740 2023-07-12 01:05:45,807 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689123975807 2023-07-12 01:05:45,808 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:05:45,808 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true, isMeta: true 2023-07-12 01:05:45,812 DEBUG [hconnection-0x4d656f2b-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:05:45,813 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=1, meta=true 2023-07-12 01:05:45,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta}] 2023-07-12 01:05:45,813 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:05:45,821 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:05:45,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:05:45,916 DEBUG [hconnection-0x4d656f2b-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:05:45,990 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39185] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=64 2023-07-12 01:05:46,011 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(300): Splitting hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, size=55.0 K (56310bytes) 2023-07-12 01:05:46,011 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta 2023-07-12 01:05:46,015 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta after 4ms 2023-07-12 01:05:46,022 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(311): Open hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta took 12ms 2023-07-12 01:05:46,035 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(346): Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:05:46,044 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0-Writer-2] util.CommonFSUtils$DfsBuilderUtility(753): Could not find replicate method on builder; will not set replicate when creating output stream java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DistributedFileSystem$HdfsDataOutputStreamBuilder.replicate() at java.lang.Class.getMethod(Class.java:1786) at org.apache.hadoop.hbase.util.CommonFSUtils$DfsBuilderUtility.(CommonFSUtils.java:750) at org.apache.hadoop.hbase.util.CommonFSUtils.createForWal(CommonFSUtils.java:802) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.initOutput(ProtobufLogWriter.java:102) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:78) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.createRecoveredEditsWriter(WALFactory.java:402) at org.apache.hadoop.hbase.wal.WALSplitter.createWriter(WALSplitter.java:516) at org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink.createRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.java:69) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.getRecoveredEditsWriter(RecoveredEditsOutputSink.java:81) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.append(RecoveredEditsOutputSink.java:63) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.writeBuffer(OutputSink.java:249) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.doRun(OutputSink.java:241) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.run(OutputSink.java:211) 2023-07-12 01:05:46,045 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta so closing down 2023-07-12 01:05:46,045 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-12 01:05:46,051 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta.temp 2023-07-12 01:05:46,053 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-12 01:05:46,072 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta.temp (wrote 60 edits, skipped 0 edits in 1 ms) 2023-07-12 01:05:46,073 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 01:05:46,074 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(423): Processed 61 edits across 1 Regions in 51 ms; skipped=1; WAL=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, size=55.0 K, length=56310, corrupted=false, cancelled=false 2023-07-12 01:05:46,074 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, journal: Splitting hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, size=55.0 K (56310bytes) at 1689123946011Finishing writing output for hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta so closing down at 1689123946045 (+34 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta.temp at 1689123946051 (+6 ms)3 split writer threads finished at 1689123946053 (+2 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta.temp (wrote 60 edits, skipped 0 edits in 1 ms) at 1689123946072 (+19 ms)Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 at 1689123946074 (+2 ms)Processed 61 edits across 1 Regions in 51 ms; skipped=1; WAL=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, size=55.0 K, length=56310, corrupted=false, cancelled=false at 1689123946074 2023-07-12 01:05:46,074 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta 2023-07-12 01:05:46,077 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=64 2023-07-12 01:05:46,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.HMaster(3641): Remote procedure done, pid=64 2023-07-12 01:05:46,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] wal.WALSplitUtil(141): Moved hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs 2023-07-12 01:05:46,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-12 01:05:46,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 in 265 msec 2023-07-12 01:05:46,091 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:05:46,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=62 2023-07-12 01:05:46,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 in 279 msec 2023-07-12 01:05:46,097 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting dir is empty, no logs to split. 2023-07-12 01:05:46,097 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=0, meta=true 2023-07-12 01:05:46,097 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,41693,1689123891259 WAL splitting is done? wals=0, meta=true 2023-07-12 01:05:46,097 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:05:46,097 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:05:46,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:05:46,097 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:05:46,119 DEBUG [hconnection-0x4d656f2b-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:05:46,423 DEBUG [hconnection-0x4d656f2b-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:05:46,932 DEBUG [hconnection-0x4d656f2b-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:05:47,939 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:47,941 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:49,963 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:49,966 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:49,966 DEBUG [hconnection-0x4d656f2b-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4155 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:53,999 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:05:54,000 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:05:54,000 DEBUG [hconnection-0x4d656f2b-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8189 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:04,076 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:04,078 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:04,078 DEBUG [hconnection-0x4d656f2b-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18267 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:14,143 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:14,144 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:14,144 DEBUG [hconnection-0x4d656f2b-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28333 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:24,239 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:24,240 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:24,240 DEBUG [hconnection-0x4d656f2b-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38429 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:34,337 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:34,340 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:34,341 DEBUG [hconnection-0x4d656f2b-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48529 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:34,343 DEBUG [Listener at localhost.localdomain/45615] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68546: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68546: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:34,344 WARN [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T01:06:34.344Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68546: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68546: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:34,344 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 2 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:06:34,344 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:06:34,344 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:06:34,344 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:06:34,345 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:06:34,345 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:06:34,345 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:06:34,345 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:06:34,345 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:06:34,347 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-12 01:06:34,349 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1] 2023-07-12 01:06:34,349 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 01:06:34,349 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 01:06:34,350 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:06:34,350 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:06:34,350 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:06:34,350 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:06:34,351 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:06:34,352 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:06:34,352 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:06:34,352 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:06:34,352 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:06:34,352 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:06:34,352 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:06:34,352 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-07-12 01:06:34,353 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:06:34,354 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,41693,1689123891259, table=hbase:meta, region=1588230740 2023-07-12 01:06:34,356 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689124024356 2023-07-12 01:06:34,357 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:06:34,359 DEBUG [hconnection-0x4d656f2b-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:06:34,359 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting dir is empty, no logs to split. 2023-07-12 01:06:34,359 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=0, meta=true 2023-07-12 01:06:34,359 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,41693,1689123891259 WAL splitting is done? wals=0, meta=true 2023-07-12 01:06:34,360 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:06:34,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 01:06:34,361 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:06:34,361 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:06:34,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:06:34,361 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:06:34,461 DEBUG [hconnection-0x4d656f2b-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:06:34,664 DEBUG [hconnection-0x4d656f2b-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:06:34,968 DEBUG [hconnection-0x4d656f2b-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:06:35,473 DEBUG [hconnection-0x4d656f2b-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:06:36,476 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:36,478 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:38,489 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:38,490 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:38,490 DEBUG [hconnection-0x4d656f2b-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4131 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:42,500 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:42,501 DEBUG [hconnection-0x4d656f2b-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8142 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:42,501 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:52,508 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:52,509 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:06:52,510 DEBUG [hconnection-0x4d656f2b-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18150 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:06:54,144 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-12 01:07:02,546 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:02,550 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:07:02,550 DEBUG [hconnection-0x4d656f2b-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28191 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:12,569 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:12,570 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:07:12,571 DEBUG [hconnection-0x4d656f2b-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38211 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:22,612 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:22,614 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:07:22,614 DEBUG [hconnection-0x4d656f2b-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48255 ms ago, cancelled=false, msg=Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:22,615 DEBUG [Listener at localhost.localdomain/45615] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68316: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68316: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:22,616 WARN [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T01:07:22.616Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68316: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68316: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase20.apache.org,41693,1689123891259, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase20.apache.org/148.251.75.209:41693 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:22,617 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 3 exec state=pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:22,617 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:07:22,617 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:07:22,617 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:07:22,617 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:07:22,617 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:07:22,617 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:07:22,617 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:07:22,618 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:07:22,619 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 01:07:22,621 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7] 2023-07-12 01:07:22,621 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 01:07:22,622 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 01:07:22,622 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:07:22,623 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:07:22,623 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:07:22,624 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:07:22,625 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:07:22,626 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:22,626 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:22,626 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:22,627 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:07:22,627 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:22,627 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:22,627 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 7 msec 2023-07-12 01:07:22,628 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:07:22,629 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,41693,1689123891259, table=hbase:meta, region=1588230740 2023-07-12 01:07:22,635 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689124072634 2023-07-12 01:07:22,636 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:07:22,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 01:07:22,636 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:07:22,638 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 01:07:22,638 DEBUG [hconnection-0x4d656f2b-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:22,639 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:22,740 DEBUG [hconnection-0x4d656f2b-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:22,789 DEBUG [jenkins-hbase20:37493] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-12 01:07:22,789 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 01:07:22,789 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 01:07:22,789 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 01:07:22,790 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 01:07:22,790 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39185,1689123891188, state=OPENING 2023-07-12 01:07:22,792 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 01:07:22,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:07:22,792 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 01:07:22,946 WARN [ReadOnlyZKClient-127.0.0.1:57181@0x59e7fd6a] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-12 01:07:22,948 DEBUG [hconnection-0x4d656f2b-shared-pool-8] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 01:07:22,954 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:07:22,955 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39185] ipc.CallRunner(144): callId: 143 service: ClientService methodName: Scan size: 97 connection: 148.251.75.209:56548 deadline: 1689124102647, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:22,961 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 01:07:22,961 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 01:07:22,963 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39185%2C1689123891188.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,39185,1689123891188, archiveDir=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs, maxLogs=32 2023-07-12 01:07:22,979 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK] 2023-07-12 01:07:22,981 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK] 2023-07-12 01:07:22,982 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK] 2023-07-12 01:07:22,985 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,39185,1689123891188/jenkins-hbase20.apache.org%2C39185%2C1689123891188.meta.1689124042965.meta 2023-07-12 01:07:22,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33375,DS-0aa47e90-ee8f-43ad-a86b-8e89cfee0c73,DISK], DatanodeInfoWithStorage[127.0.0.1:46027,DS-133d2a2e-c997-49a4-afb4-bc7461865601,DISK], DatanodeInfoWithStorage[127.0.0.1:35619,DS-32207bff-2cdb-4fc6-9fc4-a40afb082ce4,DISK]] 2023-07-12 01:07:22,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 01:07:22,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 01:07:22,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 01:07:22,987 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 01:07:22,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 01:07:22,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:22,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 01:07:22,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 01:07:22,990 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 01:07:22,991 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info 2023-07-12 01:07:22,991 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info 2023-07-12 01:07:22,992 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 01:07:22,993 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:22,993 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 01:07:22,995 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/rep_barrier 2023-07-12 01:07:22,995 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/rep_barrier 2023-07-12 01:07:22,995 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 01:07:22,996 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:22,996 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 01:07:22,997 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/table 2023-07-12 01:07:22,997 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/table 2023-07-12 01:07:22,998 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 01:07:22,998 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:22,999 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740 2023-07-12 01:07:23,001 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740 2023-07-12 01:07:23,002 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 01:07:23,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 274, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=63, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 01:07:23,016 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=51.48 KB heapSize=72.27 KB 2023-07-12 01:07:23,077 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=51.19 KB at sequenceid=63 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/.tmp/info/b70d8b6195d9403eba9044c988308538 2023-07-12 01:07:23,127 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=296 B at sequenceid=63 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/.tmp/table/5d3298825eb84e8aaf65f3ca2a3a1114 2023-07-12 01:07:23,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/.tmp/info/b70d8b6195d9403eba9044c988308538 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info/b70d8b6195d9403eba9044c988308538 2023-07-12 01:07:23,144 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info/b70d8b6195d9403eba9044c988308538, entries=270, sequenceid=63, filesize=57.3 K 2023-07-12 01:07:23,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/.tmp/table/5d3298825eb84e8aaf65f3ca2a3a1114 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/table/5d3298825eb84e8aaf65f3ca2a3a1114 2023-07-12 01:07:23,153 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/table/5d3298825eb84e8aaf65f3ca2a3a1114, entries=4, sequenceid=63, filesize=4.9 K 2023-07-12 01:07:23,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~51.48 KB/52718, heapSize ~71.99 KB/73720, currentSize=0 B/0 for 1588230740 in 138ms, sequenceid=63, compaction requested=false; wal=null 2023-07-12 01:07:23,156 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 01:07:23,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:23,163 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 01:07:23,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=1 2023-07-12 01:07:23,166 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=64; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60254404, jitterRate=-0.102139413356781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:23,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 01:07:23,171 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=66, masterSystemTime=1689124042945 2023-07-12 01:07:23,173 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 01:07:23,173 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 01:07:23,173 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39185,1689123891188, state=OPEN 2023-07-12 01:07:23,174 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 01:07:23,174 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 01:07:23,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-12 01:07:23,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 in 382 msec 2023-07-12 01:07:23,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=62 2023-07-12 01:07:23,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2023-07-12 01:07:23,311 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=dbe2f930db8a844de8e08e57b489f313, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,312 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=ca889399af08ba65a850adb2ee8395d6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,312 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,312 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a9225a5a58a47bc81419c3c6486161fd, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,313 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=75325405355a259b4d0cf0a74bbcd911, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,313 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,313 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=1a85da1c5071914c49b60e5af919979f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,313 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=b658a8e97de14ce8106a1feb87599702, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,314 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=bda21464bb715c3e773728044115c703, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,314 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=840da36b068ca121abcf9b125401ce01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,314 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,315 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,315 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,315 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,315 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=695e737124e815d7b26e317639623da8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,316 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,316 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=fdadbca7962190644ed85497b5875169, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,316 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,316 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=9e812d33d7edfde6f8072cd607e5557f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,317 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=863b75dea6bb4708953712d4bdadae9b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,317 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,317 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,317 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=4387a308fe1e2027fcba9289c9f7579e, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,317 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=961cbfe10cb28b1216894773e3260869, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,318 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=594b8a8fea092d1d008b127b6f92abca, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,318 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a009cfd3f7c2b56662acd253b84f912c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,318 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,318 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 01:07:23,318 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689124103318 2023-07-12 01:07:23,319 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689124163319 2023-07-12 01:07:23,319 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1536): Joined the cluster in 682 msec 2023-07-12 01:07:23,319 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,41693,1689123891259 had 9 regions 2023-07-12 01:07:23,320 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:07:23,320 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:23,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:07:23,320 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:07:23,569 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 4 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:23,569 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:07:23,569 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:07:23,570 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:07:23,571 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:07:23,571 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:07:23,571 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:07:23,571 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:07:23,571 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:07:23,572 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 01:07:23,574 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14] 2023-07-12 01:07:23,574 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 01:07:23,574 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 01:07:23,574 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 01:07:23,574 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 01:07:23,574 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:07:23,575 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:07:23,575 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:07:23,576 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:07:23,577 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:07:23,578 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:23,578 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:23,578 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:23,578 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 01:07:23,579 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:23,579 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:07:23,579 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,579 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,579 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,579 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,579 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 7 msec 2023-07-12 01:07:23,580 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:07:23,581 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,39185,1689123891188, table=hbase:meta, region=1588230740 2023-07-12 01:07:23,581 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689124073581 2023-07-12 01:07:23,582 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:07:23,590 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=dbe2f930db8a844de8e08e57b489f313, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,590 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=ca889399af08ba65a850adb2ee8395d6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,590 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,590 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a9225a5a58a47bc81419c3c6486161fd, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,590 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=75325405355a259b4d0cf0a74bbcd911, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,591 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,591 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=1a85da1c5071914c49b60e5af919979f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,591 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=b658a8e97de14ce8106a1feb87599702, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,591 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=bda21464bb715c3e773728044115c703, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,591 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=840da36b068ca121abcf9b125401ce01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,591 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,591 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,592 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,592 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,592 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=695e737124e815d7b26e317639623da8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,592 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,592 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=fdadbca7962190644ed85497b5875169, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,592 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,592 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=9e812d33d7edfde6f8072cd607e5557f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,593 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=863b75dea6bb4708953712d4bdadae9b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,593 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,593 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,593 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=4387a308fe1e2027fcba9289c9f7579e, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,593 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=961cbfe10cb28b1216894773e3260869, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,593 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=594b8a8fea092d1d008b127b6f92abca, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,593 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a009cfd3f7c2b56662acd253b84f912c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,594 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,594 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 01:07:23,594 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689124103594 2023-07-12 01:07:23,594 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689124163594 2023-07-12 01:07:23,594 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1536): Joined the cluster in 11 msec 2023-07-12 01:07:23,594 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,41693,1689123891259 had 8 regions 2023-07-12 01:07:23,594 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:07:23,595 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true, isMeta: false 2023-07-12 01:07:23,599 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=1, meta=false 2023-07-12 01:07:23,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657}] 2023-07-12 01:07:23,599 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:07:23,599 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:23,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:07:23,599 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:07:23,844 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 5 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:23,844 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:07:23,844 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:07:23,845 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:07:23,845 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:07:23,845 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:07:23,845 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:07:23,845 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:07:23,845 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:07:23,846 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 01:07:23,849 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16] 2023-07-12 01:07:23,849 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 01:07:23,849 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 01:07:23,849 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 01:07:23,849 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 01:07:23,850 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:07:23,850 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:07:23,851 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:07:23,851 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:07:23,852 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:07:23,853 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:23,853 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:23,853 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:23,853 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 01:07:23,853 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:23,853 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:07:23,854 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,854 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,854 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,854 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:23,854 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 7 msec 2023-07-12 01:07:23,855 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:07:23,856 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,39185,1689123891188, table=hbase:meta, region=1588230740 2023-07-12 01:07:23,856 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689124073856 2023-07-12 01:07:23,857 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:07:23,864 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=dbe2f930db8a844de8e08e57b489f313, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,864 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=ca889399af08ba65a850adb2ee8395d6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,864 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,865 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a9225a5a58a47bc81419c3c6486161fd, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,865 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=75325405355a259b4d0cf0a74bbcd911, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,865 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,865 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=1a85da1c5071914c49b60e5af919979f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,866 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=b658a8e97de14ce8106a1feb87599702, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,866 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=bda21464bb715c3e773728044115c703, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,866 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=840da36b068ca121abcf9b125401ce01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,866 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,867 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,867 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,867 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,867 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=695e737124e815d7b26e317639623da8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,867 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,867 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=fdadbca7962190644ed85497b5875169, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,867 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,868 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=9e812d33d7edfde6f8072cd607e5557f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,868 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=863b75dea6bb4708953712d4bdadae9b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,868 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,868 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,868 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=4387a308fe1e2027fcba9289c9f7579e, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,868 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=961cbfe10cb28b1216894773e3260869, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,868 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=594b8a8fea092d1d008b127b6f92abca, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:23,869 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a009cfd3f7c2b56662acd253b84f912c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:23,869 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:23,869 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 01:07:23,869 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689124103869 2023-07-12 01:07:23,869 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689124163869 2023-07-12 01:07:23,869 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1536): Joined the cluster in 12 msec 2023-07-12 01:07:23,869 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true, isMeta: false 2023-07-12 01:07:23,871 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=1, meta=false 2023-07-12 01:07:23,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657}] 2023-07-12 01:07:23,872 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:07:23,875 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:23,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:07:24,029 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39185] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=68 2023-07-12 01:07:24,040 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(300): Splitting hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, size=255.2 K (261322bytes) 2023-07-12 01:07:24,040 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 2023-07-12 01:07:24,041 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 after 1ms 2023-07-12 01:07:24,045 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(311): Open hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 took 5ms 2023-07-12 01:07:24,048 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 0228227e8813717a42ebc01d7ead1bf5: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,049 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for c4b65efc1028505129667bcbcaa0e7c9: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,050 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 120c8b9db387dd5301dffc921c87e0d8: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,052 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 695e737124e815d7b26e317639623da8: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,053 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 961cbfe10cb28b1216894773e3260869: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,054 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for f8578d7595773e9fb4bf660e4e4d3ef2: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,055 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for a4286f94dc74b552274bbaef598de52f: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,056 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(346): Last flushed sequenceid for 488292cb0f12944b5c0dae2af2ac0634: last_flushed_sequence_id: 18446744073709551615 2023-07-12 01:07:24,067 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,072 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,073 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(400): Finishing writing output for hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 so closing down 2023-07-12 01:07:24,073 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-12 01:07:24,074 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,074 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,078 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,079 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,082 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,083 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp 2023-07-12 01:07:24,085 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.OutputSink(146): 3 split writer threads finished 2023-07-12 01:07:24,127 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-12 01:07:24,127 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 01:07:24,128 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 01:07:24,128 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004 2023-07-12 01:07:24,129 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004 2023-07-12 01:07:24,132 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004 2023-07-12 01:07:24,161 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-12 01:07:24,161 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 01:07:24,161 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-12 01:07:24,163 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004 2023-07-12 01:07:24,163 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004 2023-07-12 01:07:24,163 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004 2023-07-12 01:07:24,176 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 01:07:24,176 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 01:07:24,177 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004 2023-07-12 01:07:24,177 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004 2023-07-12 01:07:24,177 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(423): Processed 16 edits across 8 Regions in 131 ms; skipped=8; WAL=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, size=255.2 K, length=261322, corrupted=false, cancelled=false 2023-07-12 01:07:24,178 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] wal.WALSplitter(426): Completed split of hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, journal: Splitting hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, size=255.2 K (261322bytes) at 1689124044040Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 1689124044067 (+27 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 1689124044072 (+5 ms)Finishing writing output for hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 so closing down at 1689124044073 (+1 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 1689124044074 (+1 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 1689124044074Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 1689124044079 (+5 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 1689124044079Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 1689124044083 (+4 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp at 16891240440833 split writer threads finished at 1689124044085 (+2 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689124044127 (+42 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689124044127Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689124044128 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004 at 1689124044129 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004 at 1689124044129Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004 at 1689124044132 (+3 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689124044161 (+29 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689124044161Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689124044161Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004 at 1689124044163 (+2 ms)Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004 at 1689124044163Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004 at 1689124044164 (+1 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689124044176 (+12 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689124044176Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004 at 1689124044177 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004-jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657.temp to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004 at 1689124044177Processed 16 edits across 8 Regions in 131 ms; skipped=8; WAL=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, size=255.2 K, length=261322, corrupted=false, cancelled=false at 1689124044178 (+1 ms) 2023-07-12 01:07:24,178 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 2023-07-12 01:07:24,178 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0-1] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=68 2023-07-12 01:07:24,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] master.HMaster(3641): Remote procedure done, pid=68 2023-07-12 01:07:24,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37493] wal.WALSplitUtil(141): Moved hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting/jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657 to hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs 2023-07-12 01:07:24,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-12 01:07:24,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 in 305 msec 2023-07-12 01:07:24,183 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=62 2023-07-12 01:07:24,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 in 311 msec 2023-07-12 01:07:24,186 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting dir is empty, no logs to split. 2023-07-12 01:07:24,186 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=0, meta=false 2023-07-12 01:07:24,186 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,41693,1689123891259 WAL splitting is done? wals=0, meta=false 2023-07-12 01:07:24,187 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:07:24,187 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:24,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:07:24,187 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:07:24,370 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 6 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:24,370 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:07:24,370 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:07:24,370 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:07:24,371 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:07:24,371 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:07:24,371 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:07:24,371 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:07:24,372 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:07:24,374 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 01:07:24,377 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18] 2023-07-12 01:07:24,377 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 01:07:24,377 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 01:07:24,377 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 01:07:24,378 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 01:07:24,378 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 01:07:24,378 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 01:07:24,378 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:07:24,379 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:07:24,379 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:07:24,379 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:07:24,380 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,381 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,382 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,382 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,382 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,382 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 7 msec 2023-07-12 01:07:24,383 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:07:24,383 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,39185,1689123891188, table=hbase:meta, region=1588230740 2023-07-12 01:07:24,383 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689124074383 2023-07-12 01:07:24,384 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:07:24,389 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=dbe2f930db8a844de8e08e57b489f313, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,389 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=ca889399af08ba65a850adb2ee8395d6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,389 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,389 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a9225a5a58a47bc81419c3c6486161fd, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,389 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=75325405355a259b4d0cf0a74bbcd911, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,389 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,389 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=1a85da1c5071914c49b60e5af919979f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,390 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=b658a8e97de14ce8106a1feb87599702, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,390 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=bda21464bb715c3e773728044115c703, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,390 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=840da36b068ca121abcf9b125401ce01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,390 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,390 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,390 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,391 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,391 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=695e737124e815d7b26e317639623da8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,391 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,391 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=fdadbca7962190644ed85497b5875169, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,391 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,391 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=9e812d33d7edfde6f8072cd607e5557f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,392 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=863b75dea6bb4708953712d4bdadae9b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,392 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,392 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,392 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=4387a308fe1e2027fcba9289c9f7579e, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,392 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=961cbfe10cb28b1216894773e3260869, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,392 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=594b8a8fea092d1d008b127b6f92abca, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,392 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a009cfd3f7c2b56662acd253b84f912c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,393 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,393 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 01:07:24,393 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689124104393 2023-07-12 01:07:24,393 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689124164393 2023-07-12 01:07:24,393 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-12 01:07:24,394 INFO [PEWorker-1] master.MasterWalManager(320): Log dir for server jenkins-hbase20.apache.org,41693,1689123891259 does not exist 2023-07-12 01:07:24,394 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,41693,1689123891259 WAL count=0, meta=false 2023-07-12 01:07:24,394 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,41693,1689123891259 WAL splitting is done? wals=0, meta=false 2023-07-12 01:07:24,395 INFO [PEWorker-1] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase20.apache.org,41693,1689123891259 failed, ignore...File hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/WALs/jenkins-hbase20.apache.org,41693,1689123891259-splitting does not exist. 2023-07-12 01:07:24,395 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:07:24,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN}] 2023-07-12 01:07:24,397 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:07:24,397 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:24,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:07:24,397 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:07:24,643 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 7 exec state=pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:24,644 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:07:24,644 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:07:24,644 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:07:24,645 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:07:24,645 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:07:24,646 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:07:24,646 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:07:24,646 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:07:24,648 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-12 01:07:24,651 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25] 2023-07-12 01:07:24,651 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 01:07:24,651 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 01:07:24,651 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 01:07:24,651 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 01:07:24,651 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 01:07:24,651 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 01:07:24,652 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:07:24,653 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:07:24,653 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:07:24,653 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:07:24,654 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,656 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:07:24,657 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,657 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,657 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,657 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,657 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,657 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:24,657 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 8 msec 2023-07-12 01:07:24,658 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:07:24,658 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,39185,1689123891188, table=hbase:meta, region=1588230740 2023-07-12 01:07:24,659 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689124074659 2023-07-12 01:07:24,660 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:07:24,664 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=dbe2f930db8a844de8e08e57b489f313, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,664 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=ca889399af08ba65a850adb2ee8395d6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,664 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,665 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a9225a5a58a47bc81419c3c6486161fd, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,665 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=75325405355a259b4d0cf0a74bbcd911, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,665 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,665 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=1a85da1c5071914c49b60e5af919979f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,665 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=b658a8e97de14ce8106a1feb87599702, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,665 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=bda21464bb715c3e773728044115c703, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,666 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=840da36b068ca121abcf9b125401ce01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,666 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,666 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,666 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,666 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,666 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=695e737124e815d7b26e317639623da8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,666 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,667 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=fdadbca7962190644ed85497b5875169, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,667 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,667 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=9e812d33d7edfde6f8072cd607e5557f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,667 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=863b75dea6bb4708953712d4bdadae9b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,667 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,667 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,667 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=4387a308fe1e2027fcba9289c9f7579e, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,668 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=961cbfe10cb28b1216894773e3260869, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,668 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=594b8a8fea092d1d008b127b6f92abca, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:24,668 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a009cfd3f7c2b56662acd253b84f912c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:24,668 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41693,1689123891259, regionLocation=jenkins-hbase20.apache.org,41693,1689123891259, openSeqNum=2 2023-07-12 01:07:24,668 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 01:07:24,668 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689124104668 2023-07-12 01:07:24,668 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689124164668 2023-07-12 01:07:24,668 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-12 01:07:24,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN}] 2023-07-12 01:07:24,670 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:07:24,671 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN 2023-07-12 01:07:24,672 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,673 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN 2023-07-12 01:07:24,673 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,674 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN 2023-07-12 01:07:24,674 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,675 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN 2023-07-12 01:07:24,676 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,676 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN 2023-07-12 01:07:24,677 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,677 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN 2023-07-12 01:07:24,678 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,678 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN 2023-07-12 01:07:24,679 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,679 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN 2023-07-12 01:07:24,680 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 01:07:24,823 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 01:07:24,824 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 01:07:24,824 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 01:07:24,824 DEBUG [jenkins-hbase20:37493] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 01:07:24,831 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=120c8b9db387dd5301dffc921c87e0d8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:24,831 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689124044831"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044831"}]},"ts":"1689124044831"} 2023-07-12 01:07:24,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=75, state=RUNNABLE; OpenRegionProcedure 120c8b9db387dd5301dffc921c87e0d8, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:07:24,842 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:24,842 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124044841"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044841"}]},"ts":"1689124044841"} 2023-07-12 01:07:24,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=78, ppid=71, state=RUNNABLE; OpenRegionProcedure c4b65efc1028505129667bcbcaa0e7c9, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:07:24,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=695e737124e815d7b26e317639623da8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:24,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124044846"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044846"}]},"ts":"1689124044846"} 2023-07-12 01:07:24,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=79, ppid=72, state=RUNNABLE; OpenRegionProcedure 695e737124e815d7b26e317639623da8, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:07:24,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=a4286f94dc74b552274bbaef598de52f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:24,851 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124044851"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044851"}]},"ts":"1689124044851"} 2023-07-12 01:07:24,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=74, state=RUNNABLE; OpenRegionProcedure a4286f94dc74b552274bbaef598de52f, server=jenkins-hbase20.apache.org,44505,1689123891229}] 2023-07-12 01:07:24,859 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=961cbfe10cb28b1216894773e3260869, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,859 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124044859"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044859"}]},"ts":"1689124044859"} 2023-07-12 01:07:24,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=73, state=RUNNABLE; OpenRegionProcedure 961cbfe10cb28b1216894773e3260869, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:07:24,863 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,863 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124044863"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044863"}]},"ts":"1689124044863"} 2023-07-12 01:07:24,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=70, state=RUNNABLE; OpenRegionProcedure f8578d7595773e9fb4bf660e4e4d3ef2, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:07:24,867 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=488292cb0f12944b5c0dae2af2ac0634, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,867 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124044866"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044866"}]},"ts":"1689124044866"} 2023-07-12 01:07:24,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=76, state=RUNNABLE; OpenRegionProcedure 488292cb0f12944b5c0dae2af2ac0634, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:07:24,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=0228227e8813717a42ebc01d7ead1bf5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:24,871 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124044870"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689124044870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689124044870"}]},"ts":"1689124044870"} 2023-07-12 01:07:24,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=69, state=RUNNABLE; OpenRegionProcedure 0228227e8813717a42ebc01d7ead1bf5, server=jenkins-hbase20.apache.org,39185,1689123891188}] 2023-07-12 01:07:24,994 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 01:07:25,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:25,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4b65efc1028505129667bcbcaa0e7c9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-12 01:07:25,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,006 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,009 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily11 2023-07-12 01:07:25,009 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily11 2023-07-12 01:07:25,009 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4b65efc1028505129667bcbcaa0e7c9 columnFamilyName colfamily11 2023-07-12 01:07:25,010 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(310): Store=c4b65efc1028505129667bcbcaa0e7c9/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,011 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,013 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily21 2023-07-12 01:07:25,013 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily21 2023-07-12 01:07:25,014 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4b65efc1028505129667bcbcaa0e7c9 columnFamilyName colfamily21 2023-07-12 01:07:25,015 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(310): Store=c4b65efc1028505129667bcbcaa0e7c9/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,015 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,017 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily31 2023-07-12 01:07:25,017 DEBUG [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily31 2023-07-12 01:07:25,017 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4b65efc1028505129667bcbcaa0e7c9 columnFamilyName colfamily31 2023-07-12 01:07:25,018 INFO [StoreOpener-c4b65efc1028505129667bcbcaa0e7c9-1] regionserver.HStore(310): Store=c4b65efc1028505129667bcbcaa0e7c9/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:25,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0228227e8813717a42ebc01d7ead1bf5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-12 01:07:25,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,021 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,023 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily11 2023-07-12 01:07:25,023 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily11 2023-07-12 01:07:25,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004 2023-07-12 01:07:25,023 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0228227e8813717a42ebc01d7ead1bf5 columnFamilyName colfamily11 2023-07-12 01:07:25,023 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(310): Store=0228227e8813717a42ebc01d7ead1bf5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,024 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,024 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily21 2023-07-12 01:07:25,024 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily21 2023-07-12 01:07:25,025 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0228227e8813717a42ebc01d7ead1bf5 columnFamilyName colfamily21 2023-07-12 01:07:25,025 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(310): Store=0228227e8813717a42ebc01d7ead1bf5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,025 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,026 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily31 2023-07-12 01:07:25,026 DEBUG [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily31 2023-07-12 01:07:25,026 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0228227e8813717a42ebc01d7ead1bf5 columnFamilyName colfamily31 2023-07-12 01:07:25,027 INFO [StoreOpener-0228227e8813717a42ebc01d7ead1bf5-1] regionserver.HStore(310): Store=0228227e8813717a42ebc01d7ead1bf5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004 2023-07-12 01:07:25,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing c4b65efc1028505129667bcbcaa0e7c9 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:25,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004 2023-07-12 01:07:25,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004 2023-07-12 01:07:25,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 0228227e8813717a42ebc01d7ead1bf5 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:25,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/.tmp/colfamily11/1db2965cfd8e48c1a98354128daebef2 2023-07-12 01:07:25,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/.tmp/colfamily11/8a14e154cf0b4b2cb7ce8749cd4b0332 2023-07-12 01:07:25,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/.tmp/colfamily11/1db2965cfd8e48c1a98354128daebef2 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily11/1db2965cfd8e48c1a98354128daebef2 2023-07-12 01:07:25,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/.tmp/colfamily11/8a14e154cf0b4b2cb7ce8749cd4b0332 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily11/8a14e154cf0b4b2cb7ce8749cd4b0332 2023-07-12 01:07:25,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/colfamily11/1db2965cfd8e48c1a98354128daebef2, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 01:07:25,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for c4b65efc1028505129667bcbcaa0e7c9 in 45ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/0000000000000000004 2023-07-12 01:07:25,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:25,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/colfamily11/8a14e154cf0b4b2cb7ce8749cd4b0332, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 01:07:25,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 0228227e8813717a42ebc01d7ead1bf5 in 43ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/0000000000000000004 2023-07-12 01:07:25,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c4b65efc1028505129667bcbcaa0e7c9; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66160180, jitterRate=-0.01413649320602417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c4b65efc1028505129667bcbcaa0e7c9: 2023-07-12 01:07:25,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9., pid=78, masterSystemTime=1689124044990 2023-07-12 01:07:25,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:25,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:25,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 695e737124e815d7b26e317639623da8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-12 01:07:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,085 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124045085"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045085"}]},"ts":"1689124045085"} 2023-07-12 01:07:25,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,088 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=78, resume processing ppid=71 2023-07-12 01:07:25,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, ppid=71, state=SUCCESS; OpenRegionProcedure c4b65efc1028505129667bcbcaa0e7c9, server=jenkins-hbase20.apache.org,44505,1689123891229 in 244 msec 2023-07-12 01:07:25,090 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily11 2023-07-12 01:07:25,090 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily11 2023-07-12 01:07:25,090 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 695e737124e815d7b26e317639623da8 columnFamilyName colfamily11 2023-07-12 01:07:25,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0228227e8813717a42ebc01d7ead1bf5; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63663351, jitterRate=-0.05134214460849762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0228227e8813717a42ebc01d7ead1bf5: 2023-07-12 01:07:25,091 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(310): Store=695e737124e815d7b26e317639623da8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,091 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN in 421 msec 2023-07-12 01:07:25,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5., pid=84, masterSystemTime=1689124045013 2023-07-12 01:07:25,092 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily21 2023-07-12 01:07:25,092 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily21 2023-07-12 01:07:25,092 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 695e737124e815d7b26e317639623da8 columnFamilyName colfamily21 2023-07-12 01:07:25,093 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(310): Store=695e737124e815d7b26e317639623da8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,093 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:25,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:25,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:25,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 488292cb0f12944b5c0dae2af2ac0634, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-12 01:07:25,094 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,094 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124045094"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045094"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045094"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045094"}]},"ts":"1689124045094"} 2023-07-12 01:07:25,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,095 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily31 2023-07-12 01:07:25,095 DEBUG [StoreOpener-695e737124e815d7b26e317639623da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily31 2023-07-12 01:07:25,096 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,096 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 695e737124e815d7b26e317639623da8 columnFamilyName colfamily31 2023-07-12 01:07:25,096 INFO [StoreOpener-695e737124e815d7b26e317639623da8-1] regionserver.HStore(310): Store=695e737124e815d7b26e317639623da8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,097 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily11 2023-07-12 01:07:25,097 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily11 2023-07-12 01:07:25,097 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 488292cb0f12944b5c0dae2af2ac0634 columnFamilyName colfamily11 2023-07-12 01:07:25,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,098 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(310): Store=488292cb0f12944b5c0dae2af2ac0634/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,098 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=69 2023-07-12 01:07:25,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=69, state=SUCCESS; OpenRegionProcedure 0228227e8813717a42ebc01d7ead1bf5, server=jenkins-hbase20.apache.org,39185,1689123891188 in 224 msec 2023-07-12 01:07:25,099 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily21 2023-07-12 01:07:25,099 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily21 2023-07-12 01:07:25,100 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 488292cb0f12944b5c0dae2af2ac0634 columnFamilyName colfamily21 2023-07-12 01:07:25,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,100 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(310): Store=488292cb0f12944b5c0dae2af2ac0634/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,100 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN in 430 msec 2023-07-12 01:07:25,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004 2023-07-12 01:07:25,101 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily31 2023-07-12 01:07:25,101 DEBUG [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily31 2023-07-12 01:07:25,102 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 488292cb0f12944b5c0dae2af2ac0634 columnFamilyName colfamily31 2023-07-12 01:07:25,102 INFO [StoreOpener-488292cb0f12944b5c0dae2af2ac0634-1] regionserver.HStore(310): Store=488292cb0f12944b5c0dae2af2ac0634/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004 2023-07-12 01:07:25,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004 2023-07-12 01:07:25,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 695e737124e815d7b26e317639623da8 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:25,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004 2023-07-12 01:07:25,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 488292cb0f12944b5c0dae2af2ac0634 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:25,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/.tmp/colfamily11/52b66230899a4429a3f21710faa02a38 2023-07-12 01:07:25,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/.tmp/colfamily11/52b66230899a4429a3f21710faa02a38 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily11/52b66230899a4429a3f21710faa02a38 2023-07-12 01:07:25,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/.tmp/colfamily11/87bbde5e5148474aae40f66a89960ef3 2023-07-12 01:07:25,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/colfamily11/52b66230899a4429a3f21710faa02a38, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 01:07:25,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 695e737124e815d7b26e317639623da8 in 42ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/0000000000000000004 2023-07-12 01:07:25,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/.tmp/colfamily11/87bbde5e5148474aae40f66a89960ef3 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily11/87bbde5e5148474aae40f66a89960ef3 2023-07-12 01:07:25,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 695e737124e815d7b26e317639623da8 2023-07-12 01:07:25,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 695e737124e815d7b26e317639623da8; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66684221, jitterRate=-0.00632767379283905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 695e737124e815d7b26e317639623da8: 2023-07-12 01:07:25,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8., pid=79, masterSystemTime=1689124044990 2023-07-12 01:07:25,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/colfamily11/87bbde5e5148474aae40f66a89960ef3, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 01:07:25,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 488292cb0f12944b5c0dae2af2ac0634 in 47ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/0000000000000000004 2023-07-12 01:07:25,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:25,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:25,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:25,160 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=695e737124e815d7b26e317639623da8, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 120c8b9db387dd5301dffc921c87e0d8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-12 01:07:25,161 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124045160"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045160"}]},"ts":"1689124045160"} 2023-07-12 01:07:25,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,162 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,163 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily11 2023-07-12 01:07:25,164 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily11 2023-07-12 01:07:25,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=79, resume processing ppid=72 2023-07-12 01:07:25,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, ppid=72, state=SUCCESS; OpenRegionProcedure 695e737124e815d7b26e317639623da8, server=jenkins-hbase20.apache.org,44505,1689123891229 in 314 msec 2023-07-12 01:07:25,164 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c8b9db387dd5301dffc921c87e0d8 columnFamilyName colfamily11 2023-07-12 01:07:25,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:25,184 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(310): Store=120c8b9db387dd5301dffc921c87e0d8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,190 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN in 495 msec 2023-07-12 01:07:25,191 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily21 2023-07-12 01:07:25,192 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily21 2023-07-12 01:07:25,192 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c8b9db387dd5301dffc921c87e0d8 columnFamilyName colfamily21 2023-07-12 01:07:25,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,192 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(310): Store=120c8b9db387dd5301dffc921c87e0d8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,193 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 488292cb0f12944b5c0dae2af2ac0634; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61532283, jitterRate=-0.08309753239154816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 488292cb0f12944b5c0dae2af2ac0634: 2023-07-12 01:07:25,193 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily31 2023-07-12 01:07:25,193 DEBUG [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily31 2023-07-12 01:07:25,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634., pid=83, masterSystemTime=1689124045013 2023-07-12 01:07:25,194 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c8b9db387dd5301dffc921c87e0d8 columnFamilyName colfamily31 2023-07-12 01:07:25,194 INFO [StoreOpener-120c8b9db387dd5301dffc921c87e0d8-1] regionserver.HStore(310): Store=120c8b9db387dd5301dffc921c87e0d8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:25,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:25,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:25,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8578d7595773e9fb4bf660e4e4d3ef2, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-12 01:07:25,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,197 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,197 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124045197"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045197"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045197"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045197"}]},"ts":"1689124045197"} 2023-07-12 01:07:25,197 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004 2023-07-12 01:07:25,199 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11 2023-07-12 01:07:25,199 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11 2023-07-12 01:07:25,199 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8578d7595773e9fb4bf660e4e4d3ef2 columnFamilyName colfamily11 2023-07-12 01:07:25,200 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(310): Store=f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,200 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,201 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily21 2023-07-12 01:07:25,201 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily21 2023-07-12 01:07:25,202 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8578d7595773e9fb4bf660e4e4d3ef2 columnFamilyName colfamily21 2023-07-12 01:07:25,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 1, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004 2023-07-12 01:07:25,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 120c8b9db387dd5301dffc921c87e0d8 3/3 column families, dataSize=48 B heapSize=888 B 2023-07-12 01:07:25,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=76 2023-07-12 01:07:25,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=76, state=SUCCESS; OpenRegionProcedure 488292cb0f12944b5c0dae2af2ac0634, server=jenkins-hbase20.apache.org,39185,1689123891188 in 331 msec 2023-07-12 01:07:25,203 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(310): Store=f8578d7595773e9fb4bf660e4e4d3ef2/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,203 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN in 533 msec 2023-07-12 01:07:25,205 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily31 2023-07-12 01:07:25,205 DEBUG [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily31 2023-07-12 01:07:25,206 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8578d7595773e9fb4bf660e4e4d3ef2 columnFamilyName colfamily31 2023-07-12 01:07:25,207 INFO [StoreOpener-f8578d7595773e9fb4bf660e4e4d3ef2-1] regionserver.HStore(310): Store=f8578d7595773e9fb4bf660e4e4d3ef2/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004 2023-07-12 01:07:25,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004 2023-07-12 01:07:25,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing f8578d7595773e9fb4bf660e4e4d3ef2 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:25,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/.tmp/colfamily11/df3e0bdad9f64c16ae4c3e8debab0f0a 2023-07-12 01:07:25,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/.tmp/colfamily11/df3e0bdad9f64c16ae4c3e8debab0f0a as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily11/df3e0bdad9f64c16ae4c3e8debab0f0a 2023-07-12 01:07:25,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/.tmp/colfamily11/ce7f7755fba34746a67c8f9a9eb32816 2023-07-12 01:07:25,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/colfamily11/df3e0bdad9f64c16ae4c3e8debab0f0a, entries=1, sequenceid=4, filesize=4.6 K 2023-07-12 01:07:25,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 120c8b9db387dd5301dffc921c87e0d8 in 49ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/0000000000000000004 2023-07-12 01:07:25,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:25,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/.tmp/colfamily11/ce7f7755fba34746a67c8f9a9eb32816 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11/ce7f7755fba34746a67c8f9a9eb32816 2023-07-12 01:07:25,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 120c8b9db387dd5301dffc921c87e0d8; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61499375, jitterRate=-0.0835878998041153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 120c8b9db387dd5301dffc921c87e0d8: 2023-07-12 01:07:25,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8., pid=77, masterSystemTime=1689124044990 2023-07-12 01:07:25,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:25,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:25,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:25,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4286f94dc74b552274bbaef598de52f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-12 01:07:25,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,263 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689124045263"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045263"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045263"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045263"}]},"ts":"1689124045263"} 2023-07-12 01:07:25,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/colfamily11/ce7f7755fba34746a67c8f9a9eb32816, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 01:07:25,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for f8578d7595773e9fb4bf660e4e4d3ef2 in 47ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,265 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/0000000000000000004 2023-07-12 01:07:25,266 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily11 2023-07-12 01:07:25,266 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily11 2023-07-12 01:07:25,267 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4286f94dc74b552274bbaef598de52f columnFamilyName colfamily11 2023-07-12 01:07:25,267 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(310): Store=a4286f94dc74b552274bbaef598de52f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,267 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=75 2023-07-12 01:07:25,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=75, state=SUCCESS; OpenRegionProcedure 120c8b9db387dd5301dffc921c87e0d8, server=jenkins-hbase20.apache.org,44505,1689123891229 in 428 msec 2023-07-12 01:07:25,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,269 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily21 2023-07-12 01:07:25,269 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily21 2023-07-12 01:07:25,269 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4286f94dc74b552274bbaef598de52f columnFamilyName colfamily21 2023-07-12 01:07:25,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN in 598 msec 2023-07-12 01:07:25,270 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(310): Store=a4286f94dc74b552274bbaef598de52f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:25,270 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,271 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily31 2023-07-12 01:07:25,271 DEBUG [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily31 2023-07-12 01:07:25,272 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4286f94dc74b552274bbaef598de52f columnFamilyName colfamily31 2023-07-12 01:07:25,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,272 INFO [StoreOpener-a4286f94dc74b552274bbaef598de52f-1] regionserver.HStore(310): Store=a4286f94dc74b552274bbaef598de52f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f8578d7595773e9fb4bf660e4e4d3ef2; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71876385, jitterRate=0.07104159891605377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f8578d7595773e9fb4bf660e4e4d3ef2: 2023-07-12 01:07:25,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2., pid=82, masterSystemTime=1689124045013 2023-07-12 01:07:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004 2023-07-12 01:07:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:25,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:25,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:25,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 961cbfe10cb28b1216894773e3260869, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-12 01:07:25,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 01:07:25,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,277 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,277 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124045277"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045277"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045277"}]},"ts":"1689124045277"} 2023-07-12 01:07:25,278 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,279 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily11 2023-07-12 01:07:25,279 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily11 2023-07-12 01:07:25,280 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961cbfe10cb28b1216894773e3260869 columnFamilyName colfamily11 2023-07-12 01:07:25,280 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(310): Store=961cbfe10cb28b1216894773e3260869/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,280 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004 2023-07-12 01:07:25,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing a4286f94dc74b552274bbaef598de52f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:25,281 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily21 2023-07-12 01:07:25,281 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily21 2023-07-12 01:07:25,282 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961cbfe10cb28b1216894773e3260869 columnFamilyName colfamily21 2023-07-12 01:07:25,282 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(310): Store=961cbfe10cb28b1216894773e3260869/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,283 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=70 2023-07-12 01:07:25,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=70, state=SUCCESS; OpenRegionProcedure f8578d7595773e9fb4bf660e4e4d3ef2, server=jenkins-hbase20.apache.org,39185,1689123891188 in 415 msec 2023-07-12 01:07:25,285 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily31 2023-07-12 01:07:25,285 DEBUG [StoreOpener-961cbfe10cb28b1216894773e3260869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily31 2023-07-12 01:07:25,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN in 614 msec 2023-07-12 01:07:25,285 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961cbfe10cb28b1216894773e3260869 columnFamilyName colfamily31 2023-07-12 01:07:25,285 INFO [StoreOpener-961cbfe10cb28b1216894773e3260869-1] regionserver.HStore(310): Store=961cbfe10cb28b1216894773e3260869/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 01:07:25,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004 2023-07-12 01:07:25,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004 2023-07-12 01:07:25,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 961cbfe10cb28b1216894773e3260869 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:25,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/.tmp/colfamily11/3c20c571c30f4a008d72c8c28ff34b15 2023-07-12 01:07:25,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/.tmp/colfamily11/3c20c571c30f4a008d72c8c28ff34b15 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily11/3c20c571c30f4a008d72c8c28ff34b15 2023-07-12 01:07:25,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/colfamily11/3c20c571c30f4a008d72c8c28ff34b15, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 01:07:25,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a4286f94dc74b552274bbaef598de52f in 39ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/0000000000000000004 2023-07-12 01:07:25,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/.tmp/colfamily11/c1058fcf3d2f4df1901be71f8da231ba 2023-07-12 01:07:25,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:25,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a4286f94dc74b552274bbaef598de52f; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60893698, jitterRate=-0.09261319041252136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a4286f94dc74b552274bbaef598de52f: 2023-07-12 01:07:25,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f., pid=80, masterSystemTime=1689124044990 2023-07-12 01:07:25,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:25,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/.tmp/colfamily11/c1058fcf3d2f4df1901be71f8da231ba as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily11/c1058fcf3d2f4df1901be71f8da231ba 2023-07-12 01:07:25,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:25,333 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,333 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124045333"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045333"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045333"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045333"}]},"ts":"1689124045333"} 2023-07-12 01:07:25,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=74 2023-07-12 01:07:25,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=74, state=SUCCESS; OpenRegionProcedure a4286f94dc74b552274bbaef598de52f, server=jenkins-hbase20.apache.org,44505,1689123891229 in 478 msec 2023-07-12 01:07:25,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN in 668 msec 2023-07-12 01:07:25,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/colfamily11/c1058fcf3d2f4df1901be71f8da231ba, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 01:07:25,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 961cbfe10cb28b1216894773e3260869 in 46ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 01:07:25,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/0000000000000000004 2023-07-12 01:07:25,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 01:07:25,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:25,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 01:07:25,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 961cbfe10cb28b1216894773e3260869; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64684095, jitterRate=-0.03613187372684479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 01:07:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 961cbfe10cb28b1216894773e3260869: 2023-07-12 01:07:25,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869., pid=81, masterSystemTime=1689124045013 2023-07-12 01:07:25,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:25,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:25,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=961cbfe10cb28b1216894773e3260869, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,351 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689124045351"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689124045351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689124045351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689124045351"}]},"ts":"1689124045351"} 2023-07-12 01:07:25,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=73 2023-07-12 01:07:25,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=73, state=SUCCESS; OpenRegionProcedure 961cbfe10cb28b1216894773e3260869, server=jenkins-hbase20.apache.org,39185,1689123891188 in 493 msec 2023-07-12 01:07:25,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=62 2023-07-12 01:07:25,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN in 685 msec 2023-07-12 01:07:25,356 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,41693,1689123891259 after splitting done 2023-07-12 01:07:25,356 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase20.apache.org,41693,1689123891259 from processing; numProcessing=0 2023-07-12 01:07:25,356 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 01:07:25,356 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:25,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:07:25,356 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] procedure.MasterProcedureTestingUtility(454): Restart 8 exec state=pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:07:25,433 ERROR [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 01:07:25,433 INFO [Listener at localhost.localdomain/45615] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 01:07:25,434 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 01:07:25,435 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25, 26, 27] 2023-07-12 01:07:25,435 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=69, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[35, 50, 55] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=84, ppid=69, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[51, 54] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=70, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[34, 46, 63] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=82, ppid=70, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[47, 62] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=71, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[33, 38, 53] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=78, ppid=71, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[39, 52] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=72, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[32, 40, 57] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=79, ppid=72, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[41, 56] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=73, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[31, 44, 67] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=81, ppid=73, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[45, 66] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=74, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[30, 42, 65] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=80, ppid=74, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[43, 64] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=75, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[29, 36, 61] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=77, ppid=75, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[37, 60] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=76, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[28, 48, 59] 2023-07-12 01:07:25,436 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=83, ppid=76, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[49, 58] 2023-07-12 01:07:25,437 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 01:07:25,437 DEBUG [Listener at localhost.localdomain/45615] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 01:07:25,437 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 01:07:25,437 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 01:07:25,437 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 01:07:25,437 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 01:07:25,438 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 01:07:25,440 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true 2023-07-12 01:07:25,440 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,440 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,440 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 01:07:25,440 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=77, ppid=75, state=SUCCESS; OpenRegionProcedure 120c8b9db387dd5301dffc921c87e0d8, server=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=78, ppid=71, state=SUCCESS; OpenRegionProcedure c4b65efc1028505129667bcbcaa0e7c9, server=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=79, ppid=72, state=SUCCESS; OpenRegionProcedure 695e737124e815d7b26e317639623da8, server=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=80, ppid=74, state=SUCCESS; OpenRegionProcedure a4286f94dc74b552274bbaef598de52f, server=jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=81, ppid=73, state=SUCCESS; OpenRegionProcedure 961cbfe10cb28b1216894773e3260869, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,441 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=82, ppid=70, state=SUCCESS; OpenRegionProcedure f8578d7595773e9fb4bf660e4e4d3ef2, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,443 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=83, ppid=76, state=SUCCESS; OpenRegionProcedure 488292cb0f12944b5c0dae2af2ac0634, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,443 DEBUG [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(468): Loading pid=84, ppid=69, state=SUCCESS; OpenRegionProcedure 0228227e8813717a42ebc01d7ead1bf5, server=jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:25,443 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 01:07:25,443 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,443 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.meta.1689123892912.meta, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,443 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,443 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase20.apache.org%2C41693%2C1689123891259.1689123892657, worker=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0228227e8813717a42ebc01d7ead1bf5, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8578d7595773e9fb4bf660e4e4d3ef2, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4b65efc1028505129667bcbcaa0e7c9, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=695e737124e815d7b26e317639623da8, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=961cbfe10cb28b1216894773e3260869, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a4286f94dc74b552274bbaef598de52f, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=120c8b9db387dd5301dffc921c87e0d8, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=488292cb0f12944b5c0dae2af2ac0634, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=77, ppid=75, state=SUCCESS; OpenRegionProcedure 120c8b9db387dd5301dffc921c87e0d8, server=jenkins-hbase20.apache.org,44505,1689123891229 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=78, ppid=71, state=SUCCESS; OpenRegionProcedure c4b65efc1028505129667bcbcaa0e7c9, server=jenkins-hbase20.apache.org,44505,1689123891229 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=79, ppid=72, state=SUCCESS; OpenRegionProcedure 695e737124e815d7b26e317639623da8, server=jenkins-hbase20.apache.org,44505,1689123891229 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=80, ppid=74, state=SUCCESS; OpenRegionProcedure a4286f94dc74b552274bbaef598de52f, server=jenkins-hbase20.apache.org,44505,1689123891229 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=81, ppid=73, state=SUCCESS; OpenRegionProcedure 961cbfe10cb28b1216894773e3260869, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=82, ppid=70, state=SUCCESS; OpenRegionProcedure f8578d7595773e9fb4bf660e4e4d3ef2, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=83, ppid=76, state=SUCCESS; OpenRegionProcedure 488292cb0f12944b5c0dae2af2ac0634, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,444 DEBUG [Listener at localhost.localdomain/45615] procedure2.Procedure(946): pid=84, ppid=69, state=SUCCESS; OpenRegionProcedure 0228227e8813717a42ebc01d7ead1bf5, server=jenkins-hbase20.apache.org,39185,1689123891188 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 01:07:25,445 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 10 msec 2023-07-12 01:07:25,445 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 01:07:25,446 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,39185,1689123891188, table=hbase:meta, region=1588230740 2023-07-12 01:07:25,446 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689124075446 2023-07-12 01:07:25,448 DEBUG [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 01:07:25,448 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41693,1689123891259; numProcessing=1 2023-07-12 01:07:25,454 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=dbe2f930db8a844de8e08e57b489f313, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,454 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=ca889399af08ba65a850adb2ee8395d6, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,455 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=0228227e8813717a42ebc01d7ead1bf5, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=5 2023-07-12 01:07:25,455 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a9225a5a58a47bc81419c3c6486161fd, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,455 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=75325405355a259b4d0cf0a74bbcd911, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,455 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a4286f94dc74b552274bbaef598de52f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=5 2023-07-12 01:07:25,455 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=1a85da1c5071914c49b60e5af919979f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,455 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=b658a8e97de14ce8106a1feb87599702, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=bda21464bb715c3e773728044115c703, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=840da36b068ca121abcf9b125401ce01, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6fa622b2d252cd13cd3d1492a2b2abf7, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=488292cb0f12944b5c0dae2af2ac0634, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=5 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f7fbdaddce570c27d6ee9957a9c6151b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=5dc4f4467bffce1548aaf5c0a32a17ff, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=695e737124e815d7b26e317639623da8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=5 2023-07-12 01:07:25,456 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=e82c5c0900eccdfd36d246bfd483cc8b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,457 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=fdadbca7962190644ed85497b5875169, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,457 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=f8578d7595773e9fb4bf660e4e4d3ef2, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=5 2023-07-12 01:07:25,457 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=9e812d33d7edfde6f8072cd607e5557f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,457 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=863b75dea6bb4708953712d4bdadae9b, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,457 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=c4b65efc1028505129667bcbcaa0e7c9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=5 2023-07-12 01:07:25,457 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=6724d7b4d9c33a2381ae9fe74f47e1f4, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,457 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=4387a308fe1e2027fcba9289c9f7579e, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,458 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=961cbfe10cb28b1216894773e3260869, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=5 2023-07-12 01:07:25,458 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=594b8a8fea092d1d008b127b6f92abca, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=2 2023-07-12 01:07:25,458 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=a009cfd3f7c2b56662acd253b84f912c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,39185,1689123891188, regionLocation=jenkins-hbase20.apache.org,39185,1689123891188, openSeqNum=2 2023-07-12 01:07:25,458 DEBUG [Listener at localhost.localdomain/45615] assignment.RegionStateStore(147): Load hbase:meta entry region=120c8b9db387dd5301dffc921c87e0d8, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,44505,1689123891229, regionLocation=jenkins-hbase20.apache.org,44505,1689123891229, openSeqNum=5 2023-07-12 01:07:25,458 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 01:07:25,458 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689124105458 2023-07-12 01:07:25,458 INFO [Listener at localhost.localdomain/45615] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689124165458 2023-07-12 01:07:25,458 INFO [Listener at localhost.localdomain/45615] assignment.AssignmentManager(1536): Joined the cluster in 10 msec 2023-07-12 01:07:25,458 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,41693,1689123891259 after splitting done 2023-07-12 01:07:25,458 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase20.apache.org,41693,1689123891259 from processing; numProcessing=0 2023-07-12 01:07:25,458 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 01:07:25,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,41693,1689123891259, splitWal=true, meta=true in 2 mins, 28.164 sec 2023-07-12 01:07:25,714 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 01:07:25,725 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:07:25,728 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 01:07:25,730 WARN [RPCClient-NioEventLoopGroup-6-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase20.apache.org/148.251.75.209:41693 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 01:07:25,732 DEBUG [RPCClient-NioEventLoopGroup-6-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase20.apache.org/148.251.75.209:41693 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase20.apache.org/148.251.75.209:41693 2023-07-12 01:07:25,833 DEBUG [hconnection-0x225bbd80-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:25,964 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 01:07:25,967 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 01:07:25,972 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 01:07:25,977 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 01:07:25,977 DEBUG [hconnection-0x225bbd80-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:26,093 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 01:07:26,097 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 01:07:26,101 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 01:07:26,105 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 01:07:26,109 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 01:07:26,113 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 01:07:26,113 DEBUG [hconnection-0x225bbd80-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:26,225 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 01:07:26,229 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 01:07:26,232 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 01:07:26,232 DEBUG [hconnection-0x225bbd80-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:26,343 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 01:07:26,346 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 01:07:26,349 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 01:07:26,349 DEBUG [hconnection-0x225bbd80-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:26,460 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 01:07:26,463 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 01:07:26,465 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 01:07:26,466 DEBUG [hconnection-0x225bbd80-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:26,581 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 01:07:26,583 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 01:07:26,585 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 01:07:26,585 DEBUG [hconnection-0x225bbd80-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:26,697 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 01:07:26,699 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 01:07:26,702 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 01:07:26,702 DEBUG [hconnection-0x225bbd80-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase20.apache.org/148.251.75.209:41693 this server is in the failed servers list 2023-07-12 01:07:26,816 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 01:07:26,822 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 01:07:26,826 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 01:07:26,829 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 01:07:26,832 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 01:07:26,835 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 01:07:26,838 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 01:07:26,841 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 01:07:26,844 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 01:07:26,847 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 01:07:26,851 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 01:07:26,855 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 01:07:26,858 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 01:07:26,862 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 01:07:26,866 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 01:07:26,869 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 01:07:26,872 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 01:07:26,876 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 01:07:26,879 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 01:07:26,883 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 01:07:26,887 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 01:07:26,890 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 01:07:26,893 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 01:07:26,897 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 01:07:26,900 DEBUG [Listener at localhost.localdomain/45615] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 01:07:26,907 WARN [Listener at localhost.localdomain/45615] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-12 01:07:26,907 INFO [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 01:07:26,907 INFO [Listener at localhost.localdomain/45615] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 01:07:26,908 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e481bac to 127.0.0.1:57181 2023-07-12 01:07:26,908 DEBUG [Listener at localhost.localdomain/45615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:07:26,908 DEBUG [Listener at localhost.localdomain/45615] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 01:07:26,908 DEBUG [Listener at localhost.localdomain/45615] util.JVMClusterUtil(257): Found active master hash=120233565, stopped=false 2023-07-12 01:07:26,908 INFO [Listener at localhost.localdomain/45615] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:07:26,910 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 01:07:26,910 INFO [Listener at localhost.localdomain/45615] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 01:07:26,910 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 01:07:26,910 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 01:07:26,913 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:07:26,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 01:07:26,914 DEBUG [Listener at localhost.localdomain/45615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59e7fd6a to 127.0.0.1:57181 2023-07-12 01:07:26,914 DEBUG [Listener at localhost.localdomain/45615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:07:26,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 01:07:26,914 INFO [Listener at localhost.localdomain/45615] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,39185,1689123891188' ***** 2023-07-12 01:07:26,914 INFO [Listener at localhost.localdomain/45615] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 01:07:26,915 INFO [RS:0;jenkins-hbase20:39185] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 01:07:26,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 01:07:26,915 INFO [RS:0;jenkins-hbase20:39185] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 01:07:26,915 INFO [RS:0;jenkins-hbase20:39185] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 01:07:26,915 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for f8578d7595773e9fb4bf660e4e4d3ef2 2023-07-12 01:07:26,916 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 5dc4f4467bffce1548aaf5c0a32a17ff 2023-07-12 01:07:26,916 INFO [Listener at localhost.localdomain/45615] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44505,1689123891229' ***** 2023-07-12 01:07:26,916 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 01:07:26,916 INFO [Listener at localhost.localdomain/45615] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 01:07:26,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f8578d7595773e9fb4bf660e4e4d3ef2, disabling compactions & flushes 2023-07-12 01:07:26,916 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 863b75dea6bb4708953712d4bdadae9b 2023-07-12 01:07:26,917 INFO [RS:1;jenkins-hbase20:44505] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 01:07:26,917 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 0228227e8813717a42ebc01d7ead1bf5 2023-07-12 01:07:26,917 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 01:07:26,917 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for fdadbca7962190644ed85497b5875169 2023-07-12 01:07:26,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:26,917 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 488292cb0f12944b5c0dae2af2ac0634 2023-07-12 01:07:26,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 961cbfe10cb28b1216894773e3260869 2023-07-12 01:07:26,917 INFO [RS:1;jenkins-hbase20:44505] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for a009cfd3f7c2b56662acd253b84f912c 2023-07-12 01:07:26,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. after waiting 0 ms 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 6fa622b2d252cd13cd3d1492a2b2abf7 2023-07-12 01:07:26,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 840da36b068ca121abcf9b125401ce01 2023-07-12 01:07:26,918 INFO [RS:1;jenkins-hbase20:44505] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 4387a308fe1e2027fcba9289c9f7579e 2023-07-12 01:07:26,918 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for e82c5c0900eccdfd36d246bfd483cc8b 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 1a85da1c5071914c49b60e5af919979f 2023-07-12 01:07:26,918 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:07:26,918 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:26,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e82c5c0900eccdfd36d246bfd483cc8b, disabling compactions & flushes 2023-07-12 01:07:26,919 DEBUG [RS:0;jenkins-hbase20:39185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7df1ebf7 to 127.0.0.1:57181 2023-07-12 01:07:26,918 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for 75325405355a259b4d0cf0a74bbcd911 2023-07-12 01:07:26,919 DEBUG [RS:0;jenkins-hbase20:39185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:07:26,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:07:26,919 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for bda21464bb715c3e773728044115c703 2023-07-12 01:07:26,920 INFO [RS:0;jenkins-hbase20:39185] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 01:07:26,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:07:26,920 INFO [RS:0;jenkins-hbase20:39185] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 01:07:26,920 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for 120c8b9db387dd5301dffc921c87e0d8 2023-07-12 01:07:26,920 INFO [RS:0;jenkins-hbase20:39185] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 01:07:26,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. after waiting 0 ms 2023-07-12 01:07:26,920 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 01:07:26,920 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for 9e812d33d7edfde6f8072cd607e5557f 2023-07-12 01:07:26,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:07:26,920 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for c4b65efc1028505129667bcbcaa0e7c9 2023-07-12 01:07:26,920 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for b658a8e97de14ce8106a1feb87599702 2023-07-12 01:07:26,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e82c5c0900eccdfd36d246bfd483cc8b 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:26,920 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for a9225a5a58a47bc81419c3c6486161fd 2023-07-12 01:07:26,920 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for a4286f94dc74b552274bbaef598de52f 2023-07-12 01:07:26,920 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for 594b8a8fea092d1d008b127b6f92abca 2023-07-12 01:07:26,921 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1474): Waiting on 14 regions to close 2023-07-12 01:07:26,921 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:07:26,921 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 01:07:26,922 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for 6724d7b4d9c33a2381ae9fe74f47e1f4 2023-07-12 01:07:26,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 01:07:26,922 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(3305): Received CLOSE for 695e737124e815d7b26e317639623da8 2023-07-12 01:07:26,922 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 01:07:26,922 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 01:07:26,922 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:26,922 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 01:07:26,922 DEBUG [RS:1;jenkins-hbase20:44505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49e249f4 to 127.0.0.1:57181 2023-07-12 01:07:26,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=12.12 KB heapSize=17.56 KB 2023-07-12 01:07:26,922 DEBUG [RS:1;jenkins-hbase20:44505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:07:26,923 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1474): Waiting on 14 regions to close 2023-07-12 01:07:26,923 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1504): Waiting on 0228227e8813717a42ebc01d7ead1bf5, 1588230740, 1a85da1c5071914c49b60e5af919979f, 4387a308fe1e2027fcba9289c9f7579e, 488292cb0f12944b5c0dae2af2ac0634, 5dc4f4467bffce1548aaf5c0a32a17ff, 6fa622b2d252cd13cd3d1492a2b2abf7, 840da36b068ca121abcf9b125401ce01, 863b75dea6bb4708953712d4bdadae9b, 961cbfe10cb28b1216894773e3260869, a009cfd3f7c2b56662acd253b84f912c, ca889399af08ba65a850adb2ee8395d6, f8578d7595773e9fb4bf660e4e4d3ef2, fdadbca7962190644ed85497b5875169 2023-07-12 01:07:26,923 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1504): Waiting on 120c8b9db387dd5301dffc921c87e0d8, 594b8a8fea092d1d008b127b6f92abca, 6724d7b4d9c33a2381ae9fe74f47e1f4, 695e737124e815d7b26e317639623da8, 75325405355a259b4d0cf0a74bbcd911, 9e812d33d7edfde6f8072cd607e5557f, a4286f94dc74b552274bbaef598de52f, a9225a5a58a47bc81419c3c6486161fd, b658a8e97de14ce8106a1feb87599702, bda21464bb715c3e773728044115c703, c4b65efc1028505129667bcbcaa0e7c9, dbe2f930db8a844de8e08e57b489f313, e82c5c0900eccdfd36d246bfd483cc8b, f7fbdaddce570c27d6ee9957a9c6151b 2023-07-12 01:07:26,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8578d7595773e9fb4bf660e4e4d3ef2/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:26,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:26,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f8578d7595773e9fb4bf660e4e4d3ef2: 2023-07-12 01:07:26,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689123894049.f8578d7595773e9fb4bf660e4e4d3ef2. 2023-07-12 01:07:26,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5dc4f4467bffce1548aaf5c0a32a17ff, disabling compactions & flushes 2023-07-12 01:07:26,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:07:26,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:07:26,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. after waiting 0 ms 2023-07-12 01:07:26,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:07:26,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 5dc4f4467bffce1548aaf5c0a32a17ff 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:26,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.12 KB at sequenceid=82 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/.tmp/info/d5f8fa4538e442d5b4247a028ca5b28c 2023-07-12 01:07:26,962 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 01:07:26,962 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 01:07:26,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/.tmp/colfamily11/804de3d0de9f40529f47ae4bc367f6e7 2023-07-12 01:07:26,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/.tmp/colfamily11/d6bfb2b57c7948ffabeb4f30a33894cf 2023-07-12 01:07:26,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/.tmp/colfamily11/804de3d0de9f40529f47ae4bc367f6e7 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily11/804de3d0de9f40529f47ae4bc367f6e7 2023-07-12 01:07:26,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/.tmp/info/d5f8fa4538e442d5b4247a028ca5b28c as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info/d5f8fa4538e442d5b4247a028ca5b28c 2023-07-12 01:07:26,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/.tmp/colfamily11/d6bfb2b57c7948ffabeb4f30a33894cf as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily11/d6bfb2b57c7948ffabeb4f30a33894cf 2023-07-12 01:07:26,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/colfamily11/804de3d0de9f40529f47ae4bc367f6e7, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:26,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/info/d5f8fa4538e442d5b4247a028ca5b28c, entries=64, sequenceid=82, filesize=17.2 K 2023-07-12 01:07:26,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~12.12 KB/12410, heapSize ~17.05 KB/17456, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=82, compaction requested=false 2023-07-12 01:07:26,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 5dc4f4467bffce1548aaf5c0a32a17ff in 52ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:26,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/colfamily11/d6bfb2b57c7948ffabeb4f30a33894cf, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:26,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for e82c5c0900eccdfd36d246bfd483cc8b in 66ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5dc4f4467bffce1548aaf5c0a32a17ff/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,001 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/meta/1588230740/recovered.edits/85.seqid, newMaxSeqId=85, maxSeqId=63 2023-07-12 01:07:27,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e82c5c0900eccdfd36d246bfd483cc8b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:07:27,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5dc4f4467bffce1548aaf5c0a32a17ff: 2023-07-12 01:07:27,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689123894049.5dc4f4467bffce1548aaf5c0a32a17ff. 2023-07-12 01:07:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 863b75dea6bb4708953712d4bdadae9b, disabling compactions & flushes 2023-07-12 01:07:27,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:07:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:07:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. after waiting 0 ms 2023-07-12 01:07:27,003 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 01:07:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:07:27,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 863b75dea6bb4708953712d4bdadae9b 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:07:27,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 01:07:27,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e82c5c0900eccdfd36d246bfd483cc8b: 2023-07-12 01:07:27,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689123894049.e82c5c0900eccdfd36d246bfd483cc8b. 2023-07-12 01:07:27,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 01:07:27,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f7fbdaddce570c27d6ee9957a9c6151b, disabling compactions & flushes 2023-07-12 01:07:27,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 01:07:27,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:07:27,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:07:27,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. after waiting 0 ms 2023-07-12 01:07:27,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:07:27,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing f7fbdaddce570c27d6ee9957a9c6151b 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/.tmp/colfamily11/5776b3d8f54e40b3813fe12d81bd40f3 2023-07-12 01:07:27,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/.tmp/colfamily11/6c28e0a3d112499bbfd0b37667fb4b2f 2023-07-12 01:07:27,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/.tmp/colfamily11/5776b3d8f54e40b3813fe12d81bd40f3 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily11/5776b3d8f54e40b3813fe12d81bd40f3 2023-07-12 01:07:27,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/.tmp/colfamily11/6c28e0a3d112499bbfd0b37667fb4b2f as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily11/6c28e0a3d112499bbfd0b37667fb4b2f 2023-07-12 01:07:27,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/colfamily11/5776b3d8f54e40b3813fe12d81bd40f3, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for f7fbdaddce570c27d6ee9957a9c6151b in 37ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/colfamily11/6c28e0a3d112499bbfd0b37667fb4b2f, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 863b75dea6bb4708953712d4bdadae9b in 44ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f7fbdaddce570c27d6ee9957a9c6151b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:07:27,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f7fbdaddce570c27d6ee9957a9c6151b: 2023-07-12 01:07:27,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689123894049.f7fbdaddce570c27d6ee9957a9c6151b. 2023-07-12 01:07:27,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 75325405355a259b4d0cf0a74bbcd911, disabling compactions & flushes 2023-07-12 01:07:27,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:07:27,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:07:27,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. after waiting 0 ms 2023-07-12 01:07:27,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:07:27,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 75325405355a259b4d0cf0a74bbcd911 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/863b75dea6bb4708953712d4bdadae9b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:07:27,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 863b75dea6bb4708953712d4bdadae9b: 2023-07-12 01:07:27,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689123894049.863b75dea6bb4708953712d4bdadae9b. 2023-07-12 01:07:27,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0228227e8813717a42ebc01d7ead1bf5, disabling compactions & flushes 2023-07-12 01:07:27,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:27,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:27,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. after waiting 0 ms 2023-07-12 01:07:27,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:27,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0228227e8813717a42ebc01d7ead1bf5/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:27,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:27,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0228227e8813717a42ebc01d7ead1bf5: 2023-07-12 01:07:27,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689123894049.0228227e8813717a42ebc01d7ead1bf5. 2023-07-12 01:07:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fdadbca7962190644ed85497b5875169, disabling compactions & flushes 2023-07-12 01:07:27,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:07:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:07:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. after waiting 0 ms 2023-07-12 01:07:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:07:27,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing fdadbca7962190644ed85497b5875169 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/.tmp/colfamily11/19861bb9423a4f4f985db6e8bbf96a53 2023-07-12 01:07:27,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/.tmp/colfamily11/19861bb9423a4f4f985db6e8bbf96a53 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily11/19861bb9423a4f4f985db6e8bbf96a53 2023-07-12 01:07:27,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/.tmp/colfamily11/02e85bd37a8d444abbf489fa98cf93de 2023-07-12 01:07:27,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/colfamily11/19861bb9423a4f4f985db6e8bbf96a53, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 75325405355a259b4d0cf0a74bbcd911 in 50ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/75325405355a259b4d0cf0a74bbcd911/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/.tmp/colfamily11/02e85bd37a8d444abbf489fa98cf93de as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily11/02e85bd37a8d444abbf489fa98cf93de 2023-07-12 01:07:27,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:07:27,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 75325405355a259b4d0cf0a74bbcd911: 2023-07-12 01:07:27,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689123894049.75325405355a259b4d0cf0a74bbcd911. 2023-07-12 01:07:27,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bda21464bb715c3e773728044115c703, disabling compactions & flushes 2023-07-12 01:07:27,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:07:27,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:07:27,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. after waiting 0 ms 2023-07-12 01:07:27,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:07:27,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing bda21464bb715c3e773728044115c703 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/colfamily11/02e85bd37a8d444abbf489fa98cf93de, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for fdadbca7962190644ed85497b5875169 in 54ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,124 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1504): Waiting on 1a85da1c5071914c49b60e5af919979f, 4387a308fe1e2027fcba9289c9f7579e, 488292cb0f12944b5c0dae2af2ac0634, 6fa622b2d252cd13cd3d1492a2b2abf7, 840da36b068ca121abcf9b125401ce01, 961cbfe10cb28b1216894773e3260869, a009cfd3f7c2b56662acd253b84f912c, ca889399af08ba65a850adb2ee8395d6, fdadbca7962190644ed85497b5875169 2023-07-12 01:07:27,124 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1504): Waiting on 120c8b9db387dd5301dffc921c87e0d8, 594b8a8fea092d1d008b127b6f92abca, 6724d7b4d9c33a2381ae9fe74f47e1f4, 695e737124e815d7b26e317639623da8, 9e812d33d7edfde6f8072cd607e5557f, a4286f94dc74b552274bbaef598de52f, a9225a5a58a47bc81419c3c6486161fd, b658a8e97de14ce8106a1feb87599702, bda21464bb715c3e773728044115c703, c4b65efc1028505129667bcbcaa0e7c9, dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:07:27,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdadbca7962190644ed85497b5875169/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:07:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fdadbca7962190644ed85497b5875169: 2023-07-12 01:07:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689123894049.fdadbca7962190644ed85497b5875169. 2023-07-12 01:07:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 488292cb0f12944b5c0dae2af2ac0634, disabling compactions & flushes 2023-07-12 01:07:27,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:27,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:27,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. after waiting 0 ms 2023-07-12 01:07:27,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:27,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/.tmp/colfamily11/1eb38013d3b542e98cf99f956b2d32e4 2023-07-12 01:07:27,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/488292cb0f12944b5c0dae2af2ac0634/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:27,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 488292cb0f12944b5c0dae2af2ac0634: 2023-07-12 01:07:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689123894049.488292cb0f12944b5c0dae2af2ac0634. 2023-07-12 01:07:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 961cbfe10cb28b1216894773e3260869, disabling compactions & flushes 2023-07-12 01:07:27,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:27,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:27,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. after waiting 0 ms 2023-07-12 01:07:27,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:27,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/.tmp/colfamily11/1eb38013d3b542e98cf99f956b2d32e4 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily11/1eb38013d3b542e98cf99f956b2d32e4 2023-07-12 01:07:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/961cbfe10cb28b1216894773e3260869/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:27,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:27,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 961cbfe10cb28b1216894773e3260869: 2023-07-12 01:07:27,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689123894049.961cbfe10cb28b1216894773e3260869. 2023-07-12 01:07:27,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a009cfd3f7c2b56662acd253b84f912c, disabling compactions & flushes 2023-07-12 01:07:27,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:07:27,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:07:27,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. after waiting 0 ms 2023-07-12 01:07:27,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:07:27,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing a009cfd3f7c2b56662acd253b84f912c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/colfamily11/1eb38013d3b542e98cf99f956b2d32e4, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for bda21464bb715c3e773728044115c703 in 44ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bda21464bb715c3e773728044115c703/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:07:27,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bda21464bb715c3e773728044115c703: 2023-07-12 01:07:27,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689123894049.bda21464bb715c3e773728044115c703. 2023-07-12 01:07:27,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 120c8b9db387dd5301dffc921c87e0d8, disabling compactions & flushes 2023-07-12 01:07:27,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:27,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:27,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. after waiting 0 ms 2023-07-12 01:07:27,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:27,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/.tmp/colfamily11/a058c1ae165b4c43abfcb4356e9cec22 2023-07-12 01:07:27,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/120c8b9db387dd5301dffc921c87e0d8/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:27,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:27,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 120c8b9db387dd5301dffc921c87e0d8: 2023-07-12 01:07:27,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689123894049.120c8b9db387dd5301dffc921c87e0d8. 2023-07-12 01:07:27,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9e812d33d7edfde6f8072cd607e5557f, disabling compactions & flushes 2023-07-12 01:07:27,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:07:27,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:07:27,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. after waiting 0 ms 2023-07-12 01:07:27,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:07:27,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 9e812d33d7edfde6f8072cd607e5557f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/.tmp/colfamily11/a058c1ae165b4c43abfcb4356e9cec22 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily11/a058c1ae165b4c43abfcb4356e9cec22 2023-07-12 01:07:27,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/colfamily11/a058c1ae165b4c43abfcb4356e9cec22, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a009cfd3f7c2b56662acd253b84f912c in 40ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/.tmp/colfamily11/deceec540c514a5fbe9b860004794c73 2023-07-12 01:07:27,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a009cfd3f7c2b56662acd253b84f912c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:07:27,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a009cfd3f7c2b56662acd253b84f912c: 2023-07-12 01:07:27,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689123894049.a009cfd3f7c2b56662acd253b84f912c. 2023-07-12 01:07:27,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6fa622b2d252cd13cd3d1492a2b2abf7, disabling compactions & flushes 2023-07-12 01:07:27,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:07:27,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:07:27,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. after waiting 0 ms 2023-07-12 01:07:27,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:07:27,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 6fa622b2d252cd13cd3d1492a2b2abf7 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/.tmp/colfamily11/deceec540c514a5fbe9b860004794c73 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily11/deceec540c514a5fbe9b860004794c73 2023-07-12 01:07:27,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/colfamily11/deceec540c514a5fbe9b860004794c73, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 9e812d33d7edfde6f8072cd607e5557f in 54ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/.tmp/colfamily11/8ab68523e8e34b8d865d5df488b2954d 2023-07-12 01:07:27,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e812d33d7edfde6f8072cd607e5557f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:07:27,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9e812d33d7edfde6f8072cd607e5557f: 2023-07-12 01:07:27,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689123894049.9e812d33d7edfde6f8072cd607e5557f. 2023-07-12 01:07:27,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c4b65efc1028505129667bcbcaa0e7c9, disabling compactions & flushes 2023-07-12 01:07:27,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:27,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:27,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. after waiting 0 ms 2023-07-12 01:07:27,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:27,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/.tmp/colfamily11/8ab68523e8e34b8d865d5df488b2954d as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily11/8ab68523e8e34b8d865d5df488b2954d 2023-07-12 01:07:27,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4b65efc1028505129667bcbcaa0e7c9/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:27,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:27,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c4b65efc1028505129667bcbcaa0e7c9: 2023-07-12 01:07:27,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689123894049.c4b65efc1028505129667bcbcaa0e7c9. 2023-07-12 01:07:27,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b658a8e97de14ce8106a1feb87599702, disabling compactions & flushes 2023-07-12 01:07:27,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:07:27,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:07:27,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. after waiting 0 ms 2023-07-12 01:07:27,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:07:27,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing b658a8e97de14ce8106a1feb87599702 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/colfamily11/8ab68523e8e34b8d865d5df488b2954d, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 6fa622b2d252cd13cd3d1492a2b2abf7 in 51ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fa622b2d252cd13cd3d1492a2b2abf7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:07:27,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6fa622b2d252cd13cd3d1492a2b2abf7: 2023-07-12 01:07:27,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689123894049.6fa622b2d252cd13cd3d1492a2b2abf7. 2023-07-12 01:07:27,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 840da36b068ca121abcf9b125401ce01, disabling compactions & flushes 2023-07-12 01:07:27,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:07:27,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:07:27,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. after waiting 0 ms 2023-07-12 01:07:27,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:07:27,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 840da36b068ca121abcf9b125401ce01 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/.tmp/colfamily11/52580cd48c2b4c358dfddd472c803174 2023-07-12 01:07:27,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/.tmp/colfamily11/52580cd48c2b4c358dfddd472c803174 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily11/52580cd48c2b4c358dfddd472c803174 2023-07-12 01:07:27,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/.tmp/colfamily11/c480452df6a842f18c1ed2d95c335672 2023-07-12 01:07:27,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/colfamily11/52580cd48c2b4c358dfddd472c803174, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for b658a8e97de14ce8106a1feb87599702 in 40ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/.tmp/colfamily11/c480452df6a842f18c1ed2d95c335672 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily11/c480452df6a842f18c1ed2d95c335672 2023-07-12 01:07:27,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b658a8e97de14ce8106a1feb87599702/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:07:27,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b658a8e97de14ce8106a1feb87599702: 2023-07-12 01:07:27,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689123894049.b658a8e97de14ce8106a1feb87599702. 2023-07-12 01:07:27,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a9225a5a58a47bc81419c3c6486161fd, disabling compactions & flushes 2023-07-12 01:07:27,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:07:27,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:07:27,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. after waiting 0 ms 2023-07-12 01:07:27,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:07:27,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing a9225a5a58a47bc81419c3c6486161fd 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/colfamily11/c480452df6a842f18c1ed2d95c335672, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 840da36b068ca121abcf9b125401ce01 in 38ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/840da36b068ca121abcf9b125401ce01/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:07:27,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 840da36b068ca121abcf9b125401ce01: 2023-07-12 01:07:27,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689123894049.840da36b068ca121abcf9b125401ce01. 2023-07-12 01:07:27,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4387a308fe1e2027fcba9289c9f7579e, disabling compactions & flushes 2023-07-12 01:07:27,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:07:27,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:07:27,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. after waiting 0 ms 2023-07-12 01:07:27,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:07:27,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 4387a308fe1e2027fcba9289c9f7579e 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/.tmp/colfamily11/86cf0ca59cac4111b2d1338ab49dddd6 2023-07-12 01:07:27,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/.tmp/colfamily11/86cf0ca59cac4111b2d1338ab49dddd6 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily11/86cf0ca59cac4111b2d1338ab49dddd6 2023-07-12 01:07:27,324 DEBUG [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1504): Waiting on 1a85da1c5071914c49b60e5af919979f, 4387a308fe1e2027fcba9289c9f7579e, ca889399af08ba65a850adb2ee8395d6 2023-07-12 01:07:27,324 DEBUG [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1504): Waiting on 594b8a8fea092d1d008b127b6f92abca, 6724d7b4d9c33a2381ae9fe74f47e1f4, 695e737124e815d7b26e317639623da8, a4286f94dc74b552274bbaef598de52f, a9225a5a58a47bc81419c3c6486161fd, dbe2f930db8a844de8e08e57b489f313 2023-07-12 01:07:27,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/.tmp/colfamily11/66d64b04d8cb41fba2286ae6c56df2f0 2023-07-12 01:07:27,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/colfamily11/86cf0ca59cac4111b2d1338ab49dddd6, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a9225a5a58a47bc81419c3c6486161fd in 28ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a9225a5a58a47bc81419c3c6486161fd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:07:27,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a9225a5a58a47bc81419c3c6486161fd: 2023-07-12 01:07:27,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689123894049.a9225a5a58a47bc81419c3c6486161fd. 2023-07-12 01:07:27,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a4286f94dc74b552274bbaef598de52f, disabling compactions & flushes 2023-07-12 01:07:27,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:27,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:27,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. after waiting 0 ms 2023-07-12 01:07:27,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:27,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/.tmp/colfamily11/66d64b04d8cb41fba2286ae6c56df2f0 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily11/66d64b04d8cb41fba2286ae6c56df2f0 2023-07-12 01:07:27,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a4286f94dc74b552274bbaef598de52f/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:27,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:27,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a4286f94dc74b552274bbaef598de52f: 2023-07-12 01:07:27,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689123894049.a4286f94dc74b552274bbaef598de52f. 2023-07-12 01:07:27,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 594b8a8fea092d1d008b127b6f92abca, disabling compactions & flushes 2023-07-12 01:07:27,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:07:27,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:07:27,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. after waiting 0 ms 2023-07-12 01:07:27,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:07:27,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 594b8a8fea092d1d008b127b6f92abca 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/colfamily11/66d64b04d8cb41fba2286ae6c56df2f0, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 4387a308fe1e2027fcba9289c9f7579e in 31ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4387a308fe1e2027fcba9289c9f7579e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:07:27,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4387a308fe1e2027fcba9289c9f7579e: 2023-07-12 01:07:27,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689123894049.4387a308fe1e2027fcba9289c9f7579e. 2023-07-12 01:07:27,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ca889399af08ba65a850adb2ee8395d6, disabling compactions & flushes 2023-07-12 01:07:27,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:07:27,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:07:27,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. after waiting 0 ms 2023-07-12 01:07:27,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:07:27,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing ca889399af08ba65a850adb2ee8395d6 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/.tmp/colfamily11/d6d22a3a73c844dc80bd4973c9925551 2023-07-12 01:07:27,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/.tmp/colfamily11/d6d22a3a73c844dc80bd4973c9925551 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily11/d6d22a3a73c844dc80bd4973c9925551 2023-07-12 01:07:27,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/.tmp/colfamily11/955564bcbde349ff8013639870105ba8 2023-07-12 01:07:27,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/colfamily11/d6d22a3a73c844dc80bd4973c9925551, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 594b8a8fea092d1d008b127b6f92abca in 30ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/594b8a8fea092d1d008b127b6f92abca/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/.tmp/colfamily11/955564bcbde349ff8013639870105ba8 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily11/955564bcbde349ff8013639870105ba8 2023-07-12 01:07:27,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:07:27,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 594b8a8fea092d1d008b127b6f92abca: 2023-07-12 01:07:27,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689123894049.594b8a8fea092d1d008b127b6f92abca. 2023-07-12 01:07:27,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing dbe2f930db8a844de8e08e57b489f313, disabling compactions & flushes 2023-07-12 01:07:27,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:07:27,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:07:27,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. after waiting 0 ms 2023-07-12 01:07:27,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:07:27,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing dbe2f930db8a844de8e08e57b489f313 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 01:07:27,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/colfamily11/955564bcbde349ff8013639870105ba8, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ca889399af08ba65a850adb2ee8395d6 in 34ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca889399af08ba65a850adb2ee8395d6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:07:27,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ca889399af08ba65a850adb2ee8395d6: 2023-07-12 01:07:27,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689123894049.ca889399af08ba65a850adb2ee8395d6. 2023-07-12 01:07:27,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1a85da1c5071914c49b60e5af919979f, disabling compactions & flushes 2023-07-12 01:07:27,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:07:27,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:07:27,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. after waiting 0 ms 2023-07-12 01:07:27,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:07:27,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1a85da1c5071914c49b60e5af919979f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/.tmp/info/f01086a3244f4812ac23ee4ffe199c2e 2023-07-12 01:07:27,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/.tmp/colfamily11/4b2e2f64d52248d683be56fde6d7426c 2023-07-12 01:07:27,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/.tmp/info/f01086a3244f4812ac23ee4ffe199c2e as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/info/f01086a3244f4812ac23ee4ffe199c2e 2023-07-12 01:07:27,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/info/f01086a3244f4812ac23ee4ffe199c2e, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 01:07:27,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/.tmp/colfamily11/4b2e2f64d52248d683be56fde6d7426c as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily11/4b2e2f64d52248d683be56fde6d7426c 2023-07-12 01:07:27,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for dbe2f930db8a844de8e08e57b489f313 in 39ms, sequenceid=6, compaction requested=false 2023-07-12 01:07:27,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/hbase/namespace/dbe2f930db8a844de8e08e57b489f313/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 01:07:27,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:07:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for dbe2f930db8a844de8e08e57b489f313: 2023-07-12 01:07:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689123893172.dbe2f930db8a844de8e08e57b489f313. 2023-07-12 01:07:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6724d7b4d9c33a2381ae9fe74f47e1f4, disabling compactions & flushes 2023-07-12 01:07:27,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:07:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:07:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. after waiting 0 ms 2023-07-12 01:07:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:07:27,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 6724d7b4d9c33a2381ae9fe74f47e1f4 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 01:07:27,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/colfamily11/4b2e2f64d52248d683be56fde6d7426c, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 1a85da1c5071914c49b60e5af919979f in 33ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1a85da1c5071914c49b60e5af919979f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:07:27,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1a85da1c5071914c49b60e5af919979f: 2023-07-12 01:07:27,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689123894049.1a85da1c5071914c49b60e5af919979f. 2023-07-12 01:07:27,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/.tmp/colfamily11/48dd8bb568e24ab3a7fbcab752d3b550 2023-07-12 01:07:27,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/.tmp/colfamily11/48dd8bb568e24ab3a7fbcab752d3b550 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily11/48dd8bb568e24ab3a7fbcab752d3b550 2023-07-12 01:07:27,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/colfamily11/48dd8bb568e24ab3a7fbcab752d3b550, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 01:07:27,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 6724d7b4d9c33a2381ae9fe74f47e1f4 in 35ms, sequenceid=5, compaction requested=false 2023-07-12 01:07:27,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6724d7b4d9c33a2381ae9fe74f47e1f4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 01:07:27,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:07:27,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6724d7b4d9c33a2381ae9fe74f47e1f4: 2023-07-12 01:07:27,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689123894049.6724d7b4d9c33a2381ae9fe74f47e1f4. 2023-07-12 01:07:27,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 695e737124e815d7b26e317639623da8, disabling compactions & flushes 2023-07-12 01:07:27,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:27,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:27,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. after waiting 0 ms 2023-07-12 01:07:27,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:27,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/695e737124e815d7b26e317639623da8/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 01:07:27,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:27,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 695e737124e815d7b26e317639623da8: 2023-07-12 01:07:27,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689123894049.695e737124e815d7b26e317639623da8. 2023-07-12 01:07:27,497 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 01:07:27,497 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 01:07:27,522 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 01:07:27,522 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 01:07:27,525 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,39185,1689123891188; all regions closed. 2023-07-12 01:07:27,525 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44505,1689123891229; all regions closed. 2023-07-12 01:07:27,532 DEBUG [RS:1;jenkins-hbase20:44505] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs 2023-07-12 01:07:27,532 INFO [RS:1;jenkins-hbase20:44505] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44505%2C1689123891229:(num 1689123892657) 2023-07-12 01:07:27,532 DEBUG [RS:1;jenkins-hbase20:44505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:07:27,532 INFO [RS:1;jenkins-hbase20:44505] regionserver.LeaseManager(133): Closed leases 2023-07-12 01:07:27,533 DEBUG [RS:0;jenkins-hbase20:39185] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs 2023-07-12 01:07:27,533 INFO [RS:1;jenkins-hbase20:44505] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 01:07:27,533 INFO [RS:0;jenkins-hbase20:39185] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39185%2C1689123891188.meta:.meta(num 1689124042965) 2023-07-12 01:07:27,533 INFO [RS:1;jenkins-hbase20:44505] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 01:07:27,533 INFO [RS:1;jenkins-hbase20:44505] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 01:07:27,533 INFO [RS:1;jenkins-hbase20:44505] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 01:07:27,533 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 01:07:27,534 INFO [RS:1;jenkins-hbase20:44505] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44505 2023-07-12 01:07:27,538 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:07:27,538 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:27,538 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44505,1689123891229 2023-07-12 01:07:27,538 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:07:27,538 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:07:27,540 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44505,1689123891229] 2023-07-12 01:07:27,540 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44505,1689123891229; numProcessing=1 2023-07-12 01:07:27,540 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44505,1689123891229 already deleted, retry=false 2023-07-12 01:07:27,541 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44505,1689123891229 expired; onlineServers=1 2023-07-12 01:07:27,542 DEBUG [RS:0;jenkins-hbase20:39185] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/oldWALs 2023-07-12 01:07:27,542 INFO [RS:0;jenkins-hbase20:39185] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39185%2C1689123891188:(num 1689123892657) 2023-07-12 01:07:27,542 DEBUG [RS:0;jenkins-hbase20:39185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:07:27,542 INFO [RS:0;jenkins-hbase20:39185] regionserver.LeaseManager(133): Closed leases 2023-07-12 01:07:27,542 INFO [RS:0;jenkins-hbase20:39185] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 01:07:27,543 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 01:07:27,543 INFO [RS:0;jenkins-hbase20:39185] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39185 2023-07-12 01:07:27,545 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,39185,1689123891188 2023-07-12 01:07:27,545 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 01:07:27,547 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,39185,1689123891188] 2023-07-12 01:07:27,547 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,39185,1689123891188; numProcessing=2 2023-07-12 01:07:27,548 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,39185,1689123891188 already deleted, retry=false 2023-07-12 01:07:27,548 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,39185,1689123891188 expired; onlineServers=0 2023-07-12 01:07:27,548 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,37493,1689123890227' ***** 2023-07-12 01:07:27,548 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 01:07:27,548 DEBUG [M:0;jenkins-hbase20:37493] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46179466, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 01:07:27,548 INFO [M:0;jenkins-hbase20:37493] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,37493,1689123890227 2023-07-12 01:07:27,549 INFO [M:0;jenkins-hbase20:37493] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,37493,1689123890227; all regions closed. 2023-07-12 01:07:27,549 DEBUG [M:0;jenkins-hbase20:37493] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 01:07:27,549 DEBUG [M:0;jenkins-hbase20:37493] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 01:07:27,549 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 01:07:27,549 DEBUG [M:0;jenkins-hbase20:37493] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 01:07:27,549 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689123892321] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689123892321,5,FailOnTimeoutGroup] 2023-07-12 01:07:27,549 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689123892320] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689123892320,5,FailOnTimeoutGroup] 2023-07-12 01:07:27,550 INFO [M:0;jenkins-hbase20:37493] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 01:07:27,550 INFO [M:0;jenkins-hbase20:37493] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 01:07:27,550 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 01:07:27,550 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 01:07:27,551 INFO [M:0;jenkins-hbase20:37493] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 01:07:27,551 DEBUG [M:0;jenkins-hbase20:37493] master.HMaster(1512): Stopping service threads 2023-07-12 01:07:27,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 01:07:27,551 INFO [M:0;jenkins-hbase20:37493] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 01:07:27,551 ERROR [M:0;jenkins-hbase20:37493] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 01:07:27,552 INFO [M:0;jenkins-hbase20:37493] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 01:07:27,552 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 01:07:27,552 DEBUG [M:0;jenkins-hbase20:37493] zookeeper.ZKUtil(398): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 01:07:27,552 WARN [M:0;jenkins-hbase20:37493] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 01:07:27,552 INFO [M:0;jenkins-hbase20:37493] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 01:07:27,552 INFO [M:0;jenkins-hbase20:37493] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 01:07:27,553 DEBUG [M:0;jenkins-hbase20:37493] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 01:07:27,553 INFO [M:0;jenkins-hbase20:37493] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:07:27,553 DEBUG [M:0;jenkins-hbase20:37493] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:07:27,553 DEBUG [M:0;jenkins-hbase20:37493] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 01:07:27,553 DEBUG [M:0;jenkins-hbase20:37493] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:07:27,553 INFO [M:0;jenkins-hbase20:37493] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=329.37 KB heapSize=384.14 KB 2023-07-12 01:07:27,571 INFO [M:0;jenkins-hbase20:37493] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=329.37 KB at sequenceid=583 (bloomFilter=true), to=hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b061eae694bd4ff8829b1c7ff9630659 2023-07-12 01:07:27,576 DEBUG [M:0;jenkins-hbase20:37493] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b061eae694bd4ff8829b1c7ff9630659 as hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b061eae694bd4ff8829b1c7ff9630659 2023-07-12 01:07:27,581 INFO [M:0;jenkins-hbase20:37493] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44213/user/jenkins/test-data/789ccbea-320a-57b0-cd88-76060a428b67/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b061eae694bd4ff8829b1c7ff9630659, entries=84, sequenceid=583, filesize=14.0 K 2023-07-12 01:07:27,582 INFO [M:0;jenkins-hbase20:37493] regionserver.HRegion(2948): Finished flush of dataSize ~329.37 KB/337274, heapSize ~384.13 KB/393344, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=583, compaction requested=false 2023-07-12 01:07:27,583 INFO [M:0;jenkins-hbase20:37493] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 01:07:27,583 DEBUG [M:0;jenkins-hbase20:37493] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 01:07:27,586 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 01:07:27,586 INFO [M:0;jenkins-hbase20:37493] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 01:07:27,587 INFO [M:0;jenkins-hbase20:37493] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37493 2023-07-12 01:07:27,588 DEBUG [M:0;jenkins-hbase20:37493] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,37493,1689123890227 already deleted, retry=false 2023-07-12 01:07:27,640 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:07:27,640 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:44505-0x1007eb59db80002, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:07:27,640 INFO [RS:1;jenkins-hbase20:44505] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44505,1689123891229; zookeeper connection closed. 2023-07-12 01:07:27,641 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e036ec] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e036ec 2023-07-12 01:07:27,740 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:07:27,740 INFO [M:0;jenkins-hbase20:37493] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,37493,1689123890227; zookeeper connection closed. 2023-07-12 01:07:27,740 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): master:37493-0x1007eb59db80000, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:07:27,841 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:07:27,841 INFO [RS:0;jenkins-hbase20:39185] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,39185,1689123891188; zookeeper connection closed. 2023-07-12 01:07:27,841 DEBUG [Listener at localhost.localdomain/45615-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x1007eb59db80001, quorum=127.0.0.1:57181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 01:07:27,842 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@dca522c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@dca522c 2023-07-12 01:07:27,842 INFO [Listener at localhost.localdomain/45615] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 01:07:27,843 WARN [Listener at localhost.localdomain/45615] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 01:07:27,850 INFO [Listener at localhost.localdomain/45615] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 01:07:27,961 WARN [BP-777867394-148.251.75.209-1689123887541 heartbeating to localhost.localdomain/127.0.0.1:44213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 01:07:27,961 WARN [BP-777867394-148.251.75.209-1689123887541 heartbeating to localhost.localdomain/127.0.0.1:44213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-777867394-148.251.75.209-1689123887541 (Datanode Uuid 6a010157-a4c8-4338-8758-6ebbb22e1e02) service to localhost.localdomain/127.0.0.1:44213 2023-07-12 01:07:27,963 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/dfs/data/data5/current/BP-777867394-148.251.75.209-1689123887541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 01:07:27,964 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/dfs/data/data6/current/BP-777867394-148.251.75.209-1689123887541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 01:07:27,966 WARN [Listener at localhost.localdomain/45615] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 01:07:27,969 INFO [Listener at localhost.localdomain/45615] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 01:07:28,072 WARN [BP-777867394-148.251.75.209-1689123887541 heartbeating to localhost.localdomain/127.0.0.1:44213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 01:07:28,072 WARN [BP-777867394-148.251.75.209-1689123887541 heartbeating to localhost.localdomain/127.0.0.1:44213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-777867394-148.251.75.209-1689123887541 (Datanode Uuid 6144f188-05d1-41f1-9f40-5792c097cdfe) service to localhost.localdomain/127.0.0.1:44213 2023-07-12 01:07:28,073 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/dfs/data/data3/current/BP-777867394-148.251.75.209-1689123887541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 01:07:28,074 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/dfs/data/data4/current/BP-777867394-148.251.75.209-1689123887541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 01:07:28,074 WARN [Listener at localhost.localdomain/45615] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 01:07:28,077 INFO [Listener at localhost.localdomain/45615] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 01:07:28,186 WARN [BP-777867394-148.251.75.209-1689123887541 heartbeating to localhost.localdomain/127.0.0.1:44213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 01:07:28,187 WARN [BP-777867394-148.251.75.209-1689123887541 heartbeating to localhost.localdomain/127.0.0.1:44213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-777867394-148.251.75.209-1689123887541 (Datanode Uuid 5f1e2cb2-a138-426b-afe9-8d21544770f9) service to localhost.localdomain/127.0.0.1:44213 2023-07-12 01:07:28,189 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/dfs/data/data1/current/BP-777867394-148.251.75.209-1689123887541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 01:07:28,190 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/353ff2bc-9e20-bf0a-f0c9-c620d01830e6/cluster_deabb09f-be51-cc9b-e1d5-1b60b7f42670/dfs/data/data2/current/BP-777867394-148.251.75.209-1689123887541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 01:07:28,216 INFO [Listener at localhost.localdomain/45615] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 01:07:28,345 INFO [Listener at localhost.localdomain/45615] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 01:07:28,430 INFO [Listener at localhost.localdomain/45615] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 01:07:28,441 INFO [Listener at localhost.localdomain/45615] hbase.ResourceChecker(175): after: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=74 (was 9) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.logRoller java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:179) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase20:41693Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (796860881) connection to localhost.localdomain/127.0.0.1:44213 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@2c7ff87b java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-5-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 java.lang.Thread.sleep(Native Method) org.apache.hadoop.metrics2.impl.JmxCacheBuster$JmxCacheBusterRunnable.run(JmxCacheBuster.java:101) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:44213 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (796860881) connection to localhost.localdomain/127.0.0.1:44213 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Abort regionserver monitor java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_META-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (796860881) connection to localhost.localdomain/127.0.0.1:44213 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: ReplicationExecutor-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/45615 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (796860881) connection to localhost.localdomain/127.0.0.1:44213 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost.localdomain:44213 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.Chore.1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:44213 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=545 (was 256) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 206), ProcessCount=169 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=4387 (was 5243)