2023-07-11 20:39:34,589 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta timeout: 13 mins 2023-07-11 20:39:34,592 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMetaWithoutZKCoordinated timeout: 13 mins 2023-07-11 20:39:34,633 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.procedure.TestSCPWithMetaWithoutZKCoordinated#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=9, OpenFileDescriptor=256, MaxFileDescriptor=60000, SystemLoadAverage=638, ProcessCount=175, AvailableMemoryMB=4832 2023-07-11 20:39:34,924 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53 2023-07-11 20:39:34,928 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 20:39:34,928 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096, deleteOnExit=true 2023-07-11 20:39:34,928 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 20:39:34,929 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/test.cache.data in system properties and HBase conf 2023-07-11 20:39:34,929 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 20:39:34,930 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/hadoop.log.dir in system properties and HBase conf 2023-07-11 20:39:34,930 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 20:39:34,930 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 20:39:34,930 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 20:39:35,045 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 20:39:35,461 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 20:39:35,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:39:35,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:39:35,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 20:39:35,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:39:35,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 20:39:35,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 20:39:35,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:39:35,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:39:35,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 20:39:35,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/nfs.dump.dir in system properties and HBase conf 2023-07-11 20:39:35,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/java.io.tmpdir in system properties and HBase conf 2023-07-11 20:39:35,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:39:35,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 20:39:35,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 20:39:36,149 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 20:39:36,154 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 20:39:36,446 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 20:39:36,630 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 20:39:36,645 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:39:36,690 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:39:36,734 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/java.io.tmpdir/Jetty_localhost_46693_hdfs____.qs2frc/webapp 2023-07-11 20:39:36,900 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46693 2023-07-11 20:39:36,911 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 20:39:36,912 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 20:39:37,397 WARN [Listener at localhost/38497] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:39:37,476 WARN [Listener at localhost/38497] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:39:37,501 WARN [Listener at localhost/38497] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:39:37,510 INFO [Listener at localhost/38497] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:39:37,517 INFO [Listener at localhost/38497] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/java.io.tmpdir/Jetty_localhost_35077_datanode____.1w1aqz/webapp 2023-07-11 20:39:37,621 INFO [Listener at localhost/38497] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35077 2023-07-11 20:39:37,954 WARN [Listener at localhost/45269] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:39:38,036 WARN [Listener at localhost/45269] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:39:38,040 WARN [Listener at localhost/45269] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:39:38,044 INFO [Listener at localhost/45269] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:39:38,050 INFO [Listener at localhost/45269] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/java.io.tmpdir/Jetty_localhost_42127_datanode____.ti4a3l/webapp 2023-07-11 20:39:38,157 INFO [Listener at localhost/45269] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42127 2023-07-11 20:39:38,169 WARN [Listener at localhost/44131] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:39:38,191 WARN [Listener at localhost/44131] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:39:38,194 WARN [Listener at localhost/44131] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:39:38,196 INFO [Listener at localhost/44131] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:39:38,203 INFO [Listener at localhost/44131] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/java.io.tmpdir/Jetty_localhost_44471_datanode____fprddh/webapp 2023-07-11 20:39:38,333 INFO [Listener at localhost/44131] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44471 2023-07-11 20:39:38,350 WARN [Listener at localhost/45761] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:39:38,547 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x668fbb6bf983cca: Processing first storage report for DS-2860b740-1f53-49d5-b065-61efe7523860 from datanode 178e423c-db3c-476d-9b66-52d5aa8ba7e8 2023-07-11 20:39:38,548 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x668fbb6bf983cca: from storage DS-2860b740-1f53-49d5-b065-61efe7523860 node DatanodeRegistration(127.0.0.1:34715, datanodeUuid=178e423c-db3c-476d-9b66-52d5aa8ba7e8, infoPort=42315, infoSecurePort=0, ipcPort=45761, storageInfo=lv=-57;cid=testClusterID;nsid=2026033376;c=1689107976230), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-11 20:39:38,549 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53a0cbc95048177f: Processing first storage report for DS-ef5a015d-a01c-490d-84a1-931660a65ca7 from datanode fe2453b4-9715-4585-a6bf-8cb9cc888e99 2023-07-11 20:39:38,549 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53a0cbc95048177f: from storage DS-ef5a015d-a01c-490d-84a1-931660a65ca7 node DatanodeRegistration(127.0.0.1:43357, datanodeUuid=fe2453b4-9715-4585-a6bf-8cb9cc888e99, infoPort=40839, infoSecurePort=0, ipcPort=45269, storageInfo=lv=-57;cid=testClusterID;nsid=2026033376;c=1689107976230), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:39:38,549 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc80a59e8281122ab: Processing first storage report for DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf from datanode 66beb83e-faa9-417a-9cba-258a7a896c12 2023-07-11 20:39:38,549 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc80a59e8281122ab: from storage DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf node DatanodeRegistration(127.0.0.1:33341, datanodeUuid=66beb83e-faa9-417a-9cba-258a7a896c12, infoPort=41693, infoSecurePort=0, ipcPort=44131, storageInfo=lv=-57;cid=testClusterID;nsid=2026033376;c=1689107976230), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:39:38,549 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x668fbb6bf983cca: Processing first storage report for DS-c3143cdb-1c1f-417f-b5f8-0bebbf8cfc9b from datanode 178e423c-db3c-476d-9b66-52d5aa8ba7e8 2023-07-11 20:39:38,549 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x668fbb6bf983cca: from storage DS-c3143cdb-1c1f-417f-b5f8-0bebbf8cfc9b node DatanodeRegistration(127.0.0.1:34715, datanodeUuid=178e423c-db3c-476d-9b66-52d5aa8ba7e8, infoPort=42315, infoSecurePort=0, ipcPort=45761, storageInfo=lv=-57;cid=testClusterID;nsid=2026033376;c=1689107976230), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:39:38,549 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53a0cbc95048177f: Processing first storage report for DS-51d67dd1-e5e6-42a2-8942-48d4c162a391 from datanode fe2453b4-9715-4585-a6bf-8cb9cc888e99 2023-07-11 20:39:38,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53a0cbc95048177f: from storage DS-51d67dd1-e5e6-42a2-8942-48d4c162a391 node DatanodeRegistration(127.0.0.1:43357, datanodeUuid=fe2453b4-9715-4585-a6bf-8cb9cc888e99, infoPort=40839, infoSecurePort=0, ipcPort=45269, storageInfo=lv=-57;cid=testClusterID;nsid=2026033376;c=1689107976230), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:39:38,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc80a59e8281122ab: Processing first storage report for DS-a07fe36a-837a-4d9b-9202-55d71072a29a from datanode 66beb83e-faa9-417a-9cba-258a7a896c12 2023-07-11 20:39:38,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc80a59e8281122ab: from storage DS-a07fe36a-837a-4d9b-9202-55d71072a29a node DatanodeRegistration(127.0.0.1:33341, datanodeUuid=66beb83e-faa9-417a-9cba-258a7a896c12, infoPort=41693, infoSecurePort=0, ipcPort=44131, storageInfo=lv=-57;cid=testClusterID;nsid=2026033376;c=1689107976230), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 20:39:38,811 DEBUG [Listener at localhost/45761] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53 2023-07-11 20:39:38,907 INFO [Listener at localhost/45761] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/zookeeper_0, clientPort=57657, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 20:39:38,925 INFO [Listener at localhost/45761] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57657 2023-07-11 20:39:38,937 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:38,940 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:39,630 INFO [Listener at localhost/45761] util.FSUtils(471): Created version file at hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e with version=8 2023-07-11 20:39:39,631 INFO [Listener at localhost/45761] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/hbase-staging 2023-07-11 20:39:39,956 INFO [Listener at localhost/45761] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 20:39:40,499 INFO [Listener at localhost/45761] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 20:39:40,531 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:40,531 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:40,532 INFO [Listener at localhost/45761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:39:40,532 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:40,532 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:39:40,701 INFO [Listener at localhost/45761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:39:40,796 DEBUG [Listener at localhost/45761] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 20:39:40,891 INFO [Listener at localhost/45761] ipc.NettyRpcServer(120): Bind to /172.31.10.131:44753 2023-07-11 20:39:40,901 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:40,903 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:40,929 INFO [Listener at localhost/45761] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44753 connecting to ZooKeeper ensemble=127.0.0.1:57657 2023-07-11 20:39:40,983 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:447530x0, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:39:40,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44753-0x101c1b924e40000 connected 2023-07-11 20:39:41,017 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:39:41,018 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:39:41,021 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:39:41,029 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44753 2023-07-11 20:39:41,029 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44753 2023-07-11 20:39:41,030 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44753 2023-07-11 20:39:41,031 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44753 2023-07-11 20:39:41,032 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44753 2023-07-11 20:39:41,038 INFO [Listener at localhost/45761] master.HMaster(444): hbase.rootdir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e, hbase.cluster.distributed=false 2023-07-11 20:39:41,113 INFO [Listener at localhost/45761] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 20:39:41,113 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,113 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,113 INFO [Listener at localhost/45761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:39:41,113 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,113 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:39:41,120 INFO [Listener at localhost/45761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:39:41,124 INFO [Listener at localhost/45761] ipc.NettyRpcServer(120): Bind to /172.31.10.131:41489 2023-07-11 20:39:41,127 INFO [Listener at localhost/45761] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:39:41,138 DEBUG [Listener at localhost/45761] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 20:39:41,139 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:41,141 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:41,143 INFO [Listener at localhost/45761] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41489 connecting to ZooKeeper ensemble=127.0.0.1:57657 2023-07-11 20:39:41,157 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:414890x0, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:39:41,159 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:414890x0, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:39:41,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41489-0x101c1b924e40001 connected 2023-07-11 20:39:41,162 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:39:41,163 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:39:41,167 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41489 2023-07-11 20:39:41,167 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41489 2023-07-11 20:39:41,168 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41489 2023-07-11 20:39:41,171 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41489 2023-07-11 20:39:41,172 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41489 2023-07-11 20:39:41,188 INFO [Listener at localhost/45761] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 20:39:41,189 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,189 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,189 INFO [Listener at localhost/45761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:39:41,190 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,190 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:39:41,190 INFO [Listener at localhost/45761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:39:41,195 INFO [Listener at localhost/45761] ipc.NettyRpcServer(120): Bind to /172.31.10.131:44935 2023-07-11 20:39:41,196 INFO [Listener at localhost/45761] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:39:41,199 DEBUG [Listener at localhost/45761] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 20:39:41,201 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:41,204 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:41,206 INFO [Listener at localhost/45761] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44935 connecting to ZooKeeper ensemble=127.0.0.1:57657 2023-07-11 20:39:41,210 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:449350x0, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:39:41,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44935-0x101c1b924e40002 connected 2023-07-11 20:39:41,211 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:39:41,212 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:39:41,213 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:39:41,218 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44935 2023-07-11 20:39:41,218 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44935 2023-07-11 20:39:41,220 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44935 2023-07-11 20:39:41,224 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44935 2023-07-11 20:39:41,224 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44935 2023-07-11 20:39:41,238 INFO [Listener at localhost/45761] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 20:39:41,238 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,239 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,239 INFO [Listener at localhost/45761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:39:41,239 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:39:41,239 INFO [Listener at localhost/45761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:39:41,239 INFO [Listener at localhost/45761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:39:41,241 INFO [Listener at localhost/45761] ipc.NettyRpcServer(120): Bind to /172.31.10.131:42009 2023-07-11 20:39:41,241 INFO [Listener at localhost/45761] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:39:41,243 DEBUG [Listener at localhost/45761] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 20:39:41,244 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:41,246 INFO [Listener at localhost/45761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:41,247 INFO [Listener at localhost/45761] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42009 connecting to ZooKeeper ensemble=127.0.0.1:57657 2023-07-11 20:39:41,251 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:420090x0, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:39:41,252 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:420090x0, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:39:41,253 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:420090x0, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:39:41,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42009-0x101c1b924e40003 connected 2023-07-11 20:39:41,255 DEBUG [Listener at localhost/45761] zookeeper.ZKUtil(164): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:39:41,259 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42009 2023-07-11 20:39:41,260 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42009 2023-07-11 20:39:41,261 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42009 2023-07-11 20:39:41,270 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42009 2023-07-11 20:39:41,287 DEBUG [Listener at localhost/45761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42009 2023-07-11 20:39:41,304 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:41,321 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 20:39:41,324 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:41,352 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:39:41,353 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:39:41,353 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:39:41,353 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:39:41,355 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:41,356 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 20:39:41,358 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,44753,1689107979782 from backup master directory 2023-07-11 20:39:41,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 20:39:41,365 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:41,365 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 20:39:41,366 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:39:41,366 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:41,370 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 20:39:41,372 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 20:39:41,477 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/hbase.id with ID: cc560617-abeb-4bcc-bc75-a7d0fbe7f993 2023-07-11 20:39:41,523 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:39:41,537 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:41,593 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x35fd0e3f to 127.0.0.1:57657 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:39:41,643 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@535b83b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:39:41,674 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:39:41,676 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 20:39:41,696 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 20:39:41,696 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 20:39:41,699 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:41,705 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:41,707 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:39:41,754 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store-tmp 2023-07-11 20:39:41,840 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:41,840 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 20:39:41,840 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:39:41,841 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:39:41,841 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 20:39:41,841 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:39:41,841 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:39:41,841 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:39:41,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/WALs/jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:41,879 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44753%2C1689107979782, suffix=, logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/WALs/jenkins-hbase5.apache.org,44753,1689107979782, archiveDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/oldWALs, maxLogs=10 2023-07-11 20:39:41,939 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK] 2023-07-11 20:39:41,939 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK] 2023-07-11 20:39:41,939 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK] 2023-07-11 20:39:41,947 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:42,018 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/WALs/jenkins-hbase5.apache.org,44753,1689107979782/jenkins-hbase5.apache.org%2C44753%2C1689107979782.1689107981891 2023-07-11 20:39:42,019 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK], DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK]] 2023-07-11 20:39:42,020 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:39:42,021 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:42,025 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:39:42,026 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:39:42,108 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:39:42,117 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 20:39:42,151 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 20:39:42,168 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:42,175 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:39:42,178 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:39:42,199 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:39:42,209 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:42,210 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59780696, jitterRate=-0.10919821262359619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:39:42,211 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:39:42,213 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 20:39:42,242 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:39:42,242 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:39:42,245 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:39:42,247 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 20:39:42,295 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 47 msec 2023-07-11 20:39:42,295 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 20:39:42,329 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 20:39:42,337 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 20:39:42,369 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 20:39:42,374 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 20:39:42,375 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 20:39:42,382 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 20:39:42,386 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 20:39:42,389 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:42,391 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 20:39:42,392 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 20:39:42,409 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 20:39:42,414 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:39:42,414 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:39:42,414 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:39:42,419 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:39:42,419 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:42,423 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,44753,1689107979782, sessionid=0x101c1b924e40000, setting cluster-up flag (Was=false) 2023-07-11 20:39:42,440 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:42,447 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 20:39:42,450 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:42,457 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:42,465 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 20:39:42,468 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:42,472 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.hbase-snapshot/.tmp 2023-07-11 20:39:42,529 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(951): ClusterId : cc560617-abeb-4bcc-bc75-a7d0fbe7f993 2023-07-11 20:39:42,547 INFO [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(951): ClusterId : cc560617-abeb-4bcc-bc75-a7d0fbe7f993 2023-07-11 20:39:42,550 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:39:42,550 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:39:42,551 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(951): ClusterId : cc560617-abeb-4bcc-bc75-a7d0fbe7f993 2023-07-11 20:39:42,556 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:39:42,559 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:39:42,559 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:39:42,562 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:39:42,562 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:39:42,562 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:39:42,562 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:39:42,566 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:39:42,568 DEBUG [RS:1;jenkins-hbase5:44935] zookeeper.ReadOnlyZKClient(139): Connect 0x18ddedc4 to 127.0.0.1:57657 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:39:42,569 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:39:42,571 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:39:42,584 DEBUG [RS:0;jenkins-hbase5:41489] zookeeper.ReadOnlyZKClient(139): Connect 0x637bf8c1 to 127.0.0.1:57657 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:39:42,591 DEBUG [RS:2;jenkins-hbase5:42009] zookeeper.ReadOnlyZKClient(139): Connect 0x237871f7 to 127.0.0.1:57657 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:39:42,671 DEBUG [RS:0;jenkins-hbase5:41489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dbc0ade, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:39:42,682 DEBUG [RS:0;jenkins-hbase5:41489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@698393b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 20:39:42,684 DEBUG [RS:2;jenkins-hbase5:42009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dbf9be8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:39:42,684 DEBUG [RS:2;jenkins-hbase5:42009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29801a87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 20:39:42,700 DEBUG [RS:1;jenkins-hbase5:44935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@161a00af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:39:42,701 DEBUG [RS:1;jenkins-hbase5:44935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@122586b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 20:39:42,714 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase5:44935 2023-07-11 20:39:42,714 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:41489 2023-07-11 20:39:42,725 INFO [RS:0;jenkins-hbase5:41489] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:39:42,725 INFO [RS:0;jenkins-hbase5:41489] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:39:42,725 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:39:42,725 INFO [RS:1;jenkins-hbase5:44935] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:39:42,731 INFO [RS:1;jenkins-hbase5:44935] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:39:42,731 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:39:42,735 INFO [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,44753,1689107979782 with isa=jenkins-hbase5.apache.org/172.31.10.131:44935, startcode=1689107981188 2023-07-11 20:39:42,735 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,44753,1689107979782 with isa=jenkins-hbase5.apache.org/172.31.10.131:41489, startcode=1689107981112 2023-07-11 20:39:42,748 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase5:42009 2023-07-11 20:39:42,749 INFO [RS:2;jenkins-hbase5:42009] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:39:42,749 INFO [RS:2;jenkins-hbase5:42009] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:39:42,749 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:39:42,751 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,44753,1689107979782 with isa=jenkins-hbase5.apache.org/172.31.10.131:42009, startcode=1689107981238 2023-07-11 20:39:42,764 DEBUG [RS:2;jenkins-hbase5:42009] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:39:42,767 DEBUG [RS:1;jenkins-hbase5:44935] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:39:42,764 DEBUG [RS:0;jenkins-hbase5:41489] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:39:42,782 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 20:39:42,796 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:39:42,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:39:42,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:39:42,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:39:42,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-11 20:39:42,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:42,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:39:42,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:42,813 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108012812 2023-07-11 20:39:42,821 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 20:39:42,839 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 20:39:42,841 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 20:39:42,853 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:39:42,856 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 20:39:42,873 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 20:39:42,874 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 20:39:42,874 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 20:39:42,875 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 20:39:42,875 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38195, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:39:42,882 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:42,875 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47431, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:39:42,875 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:44295, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:39:42,889 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 20:39:42,892 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 20:39:42,892 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 20:39:42,895 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44753] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 20:39:42,898 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 20:39:42,899 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 20:39:42,913 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44753] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 20:39:42,913 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44753] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 20:39:42,915 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689107982903,5,FailOnTimeoutGroup] 2023-07-11 20:39:42,928 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689107982917,5,FailOnTimeoutGroup] 2023-07-11 20:39:42,929 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:42,934 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 20:39:42,941 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:42,942 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:42,961 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 20:39:42,962 WARN [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 20:39:42,963 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 20:39:42,963 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 20:39:42,963 WARN [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 20:39:42,963 WARN [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 20:39:43,034 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 20:39:43,036 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 20:39:43,036 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e 2023-07-11 20:39:43,063 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,44753,1689107979782 with isa=jenkins-hbase5.apache.org/172.31.10.131:42009, startcode=1689107981238 2023-07-11 20:39:43,064 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,44753,1689107979782 with isa=jenkins-hbase5.apache.org/172.31.10.131:41489, startcode=1689107981112 2023-07-11 20:39:43,066 INFO [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,44753,1689107979782 with isa=jenkins-hbase5.apache.org/172.31.10.131:44935, startcode=1689107981188 2023-07-11 20:39:43,076 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44753] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,087 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44753] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,088 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e 2023-07-11 20:39:43,088 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38497 2023-07-11 20:39:43,090 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e 2023-07-11 20:39:43,090 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:39:43,090 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44753] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,090 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38497 2023-07-11 20:39:43,091 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:39:43,094 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e 2023-07-11 20:39:43,094 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38497 2023-07-11 20:39:43,094 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:39:43,105 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:43,109 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 20:39:43,110 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:39:43,110 DEBUG [RS:2;jenkins-hbase5:42009] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,110 WARN [RS:2;jenkins-hbase5:42009] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:39:43,111 INFO [RS:2;jenkins-hbase5:42009] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:39:43,112 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,113 DEBUG [RS:1;jenkins-hbase5:44935] zookeeper.ZKUtil(162): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,112 DEBUG [RS:0;jenkins-hbase5:41489] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,113 WARN [RS:1;jenkins-hbase5:44935] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:39:43,113 WARN [RS:0;jenkins-hbase5:41489] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:39:43,114 INFO [RS:0;jenkins-hbase5:41489] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:39:43,114 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,113 INFO [RS:1;jenkins-hbase5:44935] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:39:43,117 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,119 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,41489,1689107981112] 2023-07-11 20:39:43,119 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,44935,1689107981188] 2023-07-11 20:39:43,119 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,42009,1689107981238] 2023-07-11 20:39:43,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info 2023-07-11 20:39:43,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 20:39:43,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:43,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 20:39:43,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:39:43,126 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 20:39:43,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:43,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 20:39:43,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/table 2023-07-11 20:39:43,131 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 20:39:43,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:43,141 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740 2023-07-11 20:39:43,145 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740 2023-07-11 20:39:43,149 DEBUG [RS:2;jenkins-hbase5:42009] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,149 DEBUG [RS:1;jenkins-hbase5:44935] zookeeper.ZKUtil(162): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,149 DEBUG [RS:0;jenkins-hbase5:41489] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,150 DEBUG [RS:1;jenkins-hbase5:44935] zookeeper.ZKUtil(162): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,150 DEBUG [RS:0;jenkins-hbase5:41489] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,150 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:43,150 DEBUG [RS:2;jenkins-hbase5:42009] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,151 DEBUG [RS:1;jenkins-hbase5:44935] zookeeper.ZKUtil(162): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,151 DEBUG [RS:0;jenkins-hbase5:41489] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,152 DEBUG [RS:2;jenkins-hbase5:42009] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,153 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 20:39:43,160 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:43,161 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61968921, jitterRate=-0.0765911191701889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:43,161 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 20:39:43,162 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 20:39:43,162 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 20:39:43,162 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 20:39:43,162 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 20:39:43,162 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 20:39:43,163 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 20:39:43,165 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 20:39:43,166 DEBUG [RS:1;jenkins-hbase5:44935] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:39:43,170 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:39:43,170 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:39:43,172 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 20:39:43,172 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 20:39:43,179 INFO [RS:0;jenkins-hbase5:41489] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:39:43,179 INFO [RS:2;jenkins-hbase5:42009] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:39:43,179 INFO [RS:1;jenkins-hbase5:44935] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:39:43,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 20:39:43,205 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:39:43,205 INFO [RS:2;jenkins-hbase5:42009] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:39:43,205 INFO [RS:0;jenkins-hbase5:41489] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:39:43,206 INFO [RS:1;jenkins-hbase5:44935] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:39:43,208 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 20:39:43,212 INFO [RS:2;jenkins-hbase5:42009] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:39:43,212 INFO [RS:0;jenkins-hbase5:41489] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:39:43,212 INFO [RS:2;jenkins-hbase5:42009] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,212 INFO [RS:1;jenkins-hbase5:44935] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:39:43,212 INFO [RS:0;jenkins-hbase5:41489] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,213 INFO [RS:1;jenkins-hbase5:44935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,213 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:39:43,215 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:39:43,215 INFO [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:39:43,223 INFO [RS:0;jenkins-hbase5:41489] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,223 INFO [RS:2;jenkins-hbase5:42009] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,223 INFO [RS:1;jenkins-hbase5:44935] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,223 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,223 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:39:43,224 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,225 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:39:43,225 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,225 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,225 DEBUG [RS:0;jenkins-hbase5:41489] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,225 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,224 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,225 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,225 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,226 DEBUG [RS:1;jenkins-hbase5:44935] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,226 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,226 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:39:43,226 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,226 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,226 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,226 DEBUG [RS:2;jenkins-hbase5:42009] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:39:43,227 INFO [RS:0;jenkins-hbase5:41489] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,227 INFO [RS:0;jenkins-hbase5:41489] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,228 INFO [RS:0;jenkins-hbase5:41489] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,228 INFO [RS:2;jenkins-hbase5:42009] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,229 INFO [RS:2;jenkins-hbase5:42009] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,229 INFO [RS:2;jenkins-hbase5:42009] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,233 INFO [RS:1;jenkins-hbase5:44935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,233 INFO [RS:1;jenkins-hbase5:44935] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,233 INFO [RS:1;jenkins-hbase5:44935] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,246 INFO [RS:0;jenkins-hbase5:41489] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:39:43,246 INFO [RS:2;jenkins-hbase5:42009] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:39:43,248 INFO [RS:1;jenkins-hbase5:44935] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:39:43,250 INFO [RS:1;jenkins-hbase5:44935] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44935,1689107981188-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,250 INFO [RS:2;jenkins-hbase5:42009] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,42009,1689107981238-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,250 INFO [RS:0;jenkins-hbase5:41489] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41489,1689107981112-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,272 INFO [RS:2;jenkins-hbase5:42009] regionserver.Replication(203): jenkins-hbase5.apache.org,42009,1689107981238 started 2023-07-11 20:39:43,273 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,42009,1689107981238, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:42009, sessionid=0x101c1b924e40003 2023-07-11 20:39:43,273 INFO [RS:0;jenkins-hbase5:41489] regionserver.Replication(203): jenkins-hbase5.apache.org,41489,1689107981112 started 2023-07-11 20:39:43,273 INFO [RS:1;jenkins-hbase5:44935] regionserver.Replication(203): jenkins-hbase5.apache.org,44935,1689107981188 started 2023-07-11 20:39:43,273 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:39:43,273 INFO [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,44935,1689107981188, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:44935, sessionid=0x101c1b924e40002 2023-07-11 20:39:43,273 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,41489,1689107981112, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:41489, sessionid=0x101c1b924e40001 2023-07-11 20:39:43,273 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:39:43,273 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:39:43,273 DEBUG [RS:1;jenkins-hbase5:44935] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,273 DEBUG [RS:2;jenkins-hbase5:42009] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,274 DEBUG [RS:1;jenkins-hbase5:44935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44935,1689107981188' 2023-07-11 20:39:43,274 DEBUG [RS:0;jenkins-hbase5:41489] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,275 DEBUG [RS:1;jenkins-hbase5:44935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:39:43,274 DEBUG [RS:2;jenkins-hbase5:42009] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,42009,1689107981238' 2023-07-11 20:39:43,275 DEBUG [RS:0;jenkins-hbase5:41489] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,41489,1689107981112' 2023-07-11 20:39:43,275 DEBUG [RS:0;jenkins-hbase5:41489] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:39:43,275 DEBUG [RS:2;jenkins-hbase5:42009] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:39:43,276 DEBUG [RS:1;jenkins-hbase5:44935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:39:43,276 DEBUG [RS:2;jenkins-hbase5:42009] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:39:43,276 DEBUG [RS:0;jenkins-hbase5:41489] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:39:43,276 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:39:43,276 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:39:43,276 DEBUG [RS:1;jenkins-hbase5:44935] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,276 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:39:43,277 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:39:43,277 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:39:43,276 DEBUG [RS:1;jenkins-hbase5:44935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44935,1689107981188' 2023-07-11 20:39:43,277 DEBUG [RS:0;jenkins-hbase5:41489] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:43,277 DEBUG [RS:0;jenkins-hbase5:41489] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,41489,1689107981112' 2023-07-11 20:39:43,278 DEBUG [RS:0;jenkins-hbase5:41489] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:39:43,277 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:39:43,277 DEBUG [RS:1;jenkins-hbase5:44935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:39:43,278 DEBUG [RS:2;jenkins-hbase5:42009] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:43,278 DEBUG [RS:2;jenkins-hbase5:42009] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,42009,1689107981238' 2023-07-11 20:39:43,278 DEBUG [RS:2;jenkins-hbase5:42009] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:39:43,278 DEBUG [RS:0;jenkins-hbase5:41489] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:39:43,278 DEBUG [RS:1;jenkins-hbase5:44935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:39:43,278 DEBUG [RS:2;jenkins-hbase5:42009] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:39:43,279 DEBUG [RS:0;jenkins-hbase5:41489] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:39:43,279 INFO [RS:0;jenkins-hbase5:41489] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:39:43,279 DEBUG [RS:1;jenkins-hbase5:44935] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:39:43,279 INFO [RS:0;jenkins-hbase5:41489] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:39:43,280 DEBUG [RS:2;jenkins-hbase5:42009] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:39:43,279 INFO [RS:1;jenkins-hbase5:44935] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:39:43,280 INFO [RS:2;jenkins-hbase5:42009] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:39:43,280 INFO [RS:1;jenkins-hbase5:44935] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:39:43,287 INFO [RS:2;jenkins-hbase5:42009] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:39:43,360 DEBUG [jenkins-hbase5:44753] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 20:39:43,364 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:39:43,369 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:39:43,370 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:39:43,370 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:39:43,370 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:39:43,372 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,44935,1689107981188, state=OPENING 2023-07-11 20:39:43,380 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 20:39:43,382 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:43,383 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:39:43,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:43,391 INFO [RS:0;jenkins-hbase5:41489] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C41489%2C1689107981112, suffix=, logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,41489,1689107981112, archiveDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs, maxLogs=32 2023-07-11 20:39:43,391 INFO [RS:2;jenkins-hbase5:42009] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C42009%2C1689107981238, suffix=, logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,42009,1689107981238, archiveDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs, maxLogs=32 2023-07-11 20:39:43,392 INFO [RS:1;jenkins-hbase5:44935] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44935%2C1689107981188, suffix=, logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188, archiveDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs, maxLogs=32 2023-07-11 20:39:43,426 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK] 2023-07-11 20:39:43,429 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK] 2023-07-11 20:39:43,430 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK] 2023-07-11 20:39:43,430 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK] 2023-07-11 20:39:43,444 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK] 2023-07-11 20:39:43,445 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK] 2023-07-11 20:39:43,445 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK] 2023-07-11 20:39:43,445 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK] 2023-07-11 20:39:43,454 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK] 2023-07-11 20:39:43,461 INFO [RS:2;jenkins-hbase5:42009] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,42009,1689107981238/jenkins-hbase5.apache.org%2C42009%2C1689107981238.1689107983396 2023-07-11 20:39:43,461 INFO [RS:1;jenkins-hbase5:44935] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 2023-07-11 20:39:43,461 INFO [RS:0;jenkins-hbase5:41489] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,41489,1689107981112/jenkins-hbase5.apache.org%2C41489%2C1689107981112.1689107983396 2023-07-11 20:39:43,461 DEBUG [RS:2;jenkins-hbase5:42009] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK], DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK]] 2023-07-11 20:39:43,462 DEBUG [RS:1;jenkins-hbase5:44935] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK], DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK]] 2023-07-11 20:39:43,462 DEBUG [RS:0;jenkins-hbase5:41489] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK], DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK]] 2023-07-11 20:39:43,581 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:43,585 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:39:43,593 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:35204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:39:43,606 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 20:39:43,607 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:39:43,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta, suffix=.meta, logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188, archiveDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs, maxLogs=32 2023-07-11 20:39:43,637 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK] 2023-07-11 20:39:43,637 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK] 2023-07-11 20:39:43,637 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK] 2023-07-11 20:39:43,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta 2023-07-11 20:39:43,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK], DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK]] 2023-07-11 20:39:43,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:39:43,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 20:39:43,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 20:39:43,678 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 20:39:43,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 20:39:43,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:43,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 20:39:43,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 20:39:43,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 20:39:43,696 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info 2023-07-11 20:39:43,696 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info 2023-07-11 20:39:43,697 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 20:39:43,698 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:43,698 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 20:39:43,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:39:43,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:39:43,701 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 20:39:43,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:43,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 20:39:43,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/table 2023-07-11 20:39:43,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/table 2023-07-11 20:39:43,704 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 20:39:43,705 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:43,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740 2023-07-11 20:39:43,713 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740 2023-07-11 20:39:43,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:43,724 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 20:39:43,726 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65168539, jitterRate=-0.028913095593452454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:43,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 20:39:43,741 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689107983570 2023-07-11 20:39:43,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 20:39:43,761 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 20:39:43,762 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,44935,1689107981188, state=OPEN 2023-07-11 20:39:43,765 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 20:39:43,765 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:39:43,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 20:39:43,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,44935,1689107981188 in 379 msec 2023-07-11 20:39:43,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 20:39:43,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 587 msec 2023-07-11 20:39:43,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2180 sec 2023-07-11 20:39:43,782 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689107983782, completionTime=-1 2023-07-11 20:39:43,782 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 20:39:43,783 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:39:43,866 DEBUG [hconnection-0x3b52e725-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:39:43,871 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:35210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:39:43,891 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 20:39:43,891 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689108043891 2023-07-11 20:39:43,892 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689108103892 2023-07-11 20:39:43,892 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 109 msec 2023-07-11 20:39:43,923 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44753,1689107979782-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,923 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44753,1689107979782-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,923 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44753,1689107979782-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,925 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:44753, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,925 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 20:39:43,934 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 20:39:43,942 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 20:39:43,944 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:39:43,954 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 20:39:43,957 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:39:43,959 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:39:43,985 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:43,988 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948 empty. 2023-07-11 20:39:43,989 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:43,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 20:39:44,033 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 20:39:44,036 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c8518b9630dfef8e8a84f34bffa19948, NAME => 'hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:44,058 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:44,058 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c8518b9630dfef8e8a84f34bffa19948, disabling compactions & flushes 2023-07-11 20:39:44,058 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:39:44,059 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:39:44,059 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. after waiting 0 ms 2023-07-11 20:39:44,059 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:39:44,059 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:39:44,059 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c8518b9630dfef8e8a84f34bffa19948: 2023-07-11 20:39:44,064 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:39:44,086 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689107984067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107984067"}]},"ts":"1689107984067"} 2023-07-11 20:39:44,128 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 20:39:44,130 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:39:44,137 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689107984131"}]},"ts":"1689107984131"} 2023-07-11 20:39:44,151 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 20:39:44,156 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:39:44,158 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:39:44,158 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:39:44,158 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:39:44,158 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:39:44,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN}] 2023-07-11 20:39:44,166 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN 2023-07-11 20:39:44,171 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:44,323 INFO [jenkins-hbase5:44753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 20:39:44,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c8518b9630dfef8e8a84f34bffa19948, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:44,324 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689107984324"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107984324"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107984324"}]},"ts":"1689107984324"} 2023-07-11 20:39:44,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c8518b9630dfef8e8a84f34bffa19948, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:44,502 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:39:44,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8518b9630dfef8e8a84f34bffa19948, NAME => 'hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:39:44,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:44,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:44,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:44,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:44,513 INFO [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:44,520 DEBUG [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/info 2023-07-11 20:39:44,520 DEBUG [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/info 2023-07-11 20:39:44,522 INFO [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8518b9630dfef8e8a84f34bffa19948 columnFamilyName info 2023-07-11 20:39:44,527 INFO [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] regionserver.HStore(310): Store=c8518b9630dfef8e8a84f34bffa19948/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:44,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:44,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:44,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:39:44,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:44,546 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c8518b9630dfef8e8a84f34bffa19948; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72061729, jitterRate=0.07380343973636627}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:39:44,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c8518b9630dfef8e8a84f34bffa19948: 2023-07-11 20:39:44,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948., pid=6, masterSystemTime=1689107984482 2023-07-11 20:39:44,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:39:44,552 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:39:44,553 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:44,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689107984553"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107984553"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107984553"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107984553"}]},"ts":"1689107984553"} 2023-07-11 20:39:44,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 20:39:44,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c8518b9630dfef8e8a84f34bffa19948, server=jenkins-hbase5.apache.org,44935,1689107981188 in 230 msec 2023-07-11 20:39:44,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 20:39:44,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN in 402 msec 2023-07-11 20:39:44,570 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:39:44,570 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689107984570"}]},"ts":"1689107984570"} 2023-07-11 20:39:44,573 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 20:39:44,576 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:39:44,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 632 msec 2023-07-11 20:39:44,657 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 20:39:44,660 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:39:44,660 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:39:44,702 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 20:39:44,722 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:39:44,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-11 20:39:44,737 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:39:44,748 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:39:44,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-11 20:39:44,762 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 20:39:44,766 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 20:39:44,766 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.400sec 2023-07-11 20:39:44,769 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 20:39:44,770 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 20:39:44,770 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 20:39:44,772 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44753,1689107979782-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 20:39:44,772 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44753,1689107979782-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 20:39:44,781 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 20:39:44,854 DEBUG [Listener at localhost/45761] zookeeper.ReadOnlyZKClient(139): Connect 0x5eb31403 to 127.0.0.1:57657 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:39:44,867 DEBUG [Listener at localhost/45761] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@549592b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:39:44,888 DEBUG [hconnection-0x13b46851-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:39:44,905 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:35220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:39:44,918 INFO [Listener at localhost/45761] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:44,922 WARN [Listener at localhost/45761] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-11 20:39:44,937 DEBUG [Listener at localhost/45761] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 20:39:44,941 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 20:39:44,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:39:44,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:39:44,976 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:39:44,981 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:39:44,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true" procId is: 9 2023-07-11 20:39:45,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:39:45,076 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:45,077 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:45,077 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:45,078 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510 empty. 2023-07-11 20:39:45,079 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:45,079 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:45,078 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:45,078 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9 empty. 2023-07-11 20:39:45,077 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:45,077 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:45,080 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452 empty. 2023-07-11 20:39:45,081 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83 empty. 2023-07-11 20:39:45,082 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf empty. 2023-07-11 20:39:45,082 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558 empty. 2023-07-11 20:39:45,085 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:45,087 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:45,087 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170 empty. 2023-07-11 20:39:45,087 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:45,087 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:45,087 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:45,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:45,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:45,088 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12 empty. 2023-07-11 20:39:45,088 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:45,088 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:45,088 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7 empty. 2023-07-11 20:39:45,088 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d empty. 2023-07-11 20:39:45,089 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f empty. 2023-07-11 20:39:45,089 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:45,089 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:45,090 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:45,090 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:45,090 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:45,090 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:45,090 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600 empty. 2023-07-11 20:39:45,091 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2 empty. 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5 empty. 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09 empty. 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:45,093 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:45,093 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:45,093 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:45,093 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:45,094 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6 empty. 2023-07-11 20:39:45,094 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81 empty. 2023-07-11 20:39:45,095 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1 empty. 2023-07-11 20:39:45,092 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:45,093 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:45,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:45,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a empty. 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5 empty. 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c empty. 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442 empty. 2023-07-11 20:39:45,100 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:45,100 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:45,100 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be empty. 2023-07-11 20:39:45,099 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:45,100 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:45,100 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf empty. 2023-07-11 20:39:45,104 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:45,104 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:45,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:45,104 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:45,104 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf empty. 2023-07-11 20:39:45,104 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:45,105 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:45,106 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021 empty. 2023-07-11 20:39:45,107 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:45,107 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:45,107 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true regions 2023-07-11 20:39:45,157 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/.tabledesc/.tableinfo.0000000001 2023-07-11 20:39:45,162 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 032d0495ec0964438e1a1750441fa9f9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9.', STARTKEY => '', ENDKEY => 'bbb'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:39:45,163 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => e6cc1f00c76bab58b5f481134121b510, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.', STARTKEY => 'bbb', ENDKEY => 'ccc'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,169 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2ca9cb0f701c87260f2be41ccb924558, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558.', STARTKEY => 'ccc', ENDKEY => 'ddd'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,246 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,246 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 2ca9cb0f701c87260f2be41ccb924558, disabling compactions & flushes 2023-07-11 20:39:45,246 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:45,247 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:45,247 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. after waiting 0 ms 2023-07-11 20:39:45,247 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:45,247 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:45,247 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 2ca9cb0f701c87260f2be41ccb924558: 2023-07-11 20:39:45,247 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1f1f55e7b9bb4f716044688e8cde5170, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170.', STARTKEY => 'ddd', ENDKEY => 'eee'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,248 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,248 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,249 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 032d0495ec0964438e1a1750441fa9f9, disabling compactions & flushes 2023-07-11 20:39:45,249 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing e6cc1f00c76bab58b5f481134121b510, disabling compactions & flushes 2023-07-11 20:39:45,249 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:45,249 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:45,249 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. after waiting 0 ms 2023-07-11 20:39:45,249 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:45,250 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:45,250 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for e6cc1f00c76bab58b5f481134121b510: 2023-07-11 20:39:45,250 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 126966e5d395a2142294de9a3be86ebf, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf.', STARTKEY => 'eee', ENDKEY => 'fff'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,249 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:45,250 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:45,250 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. after waiting 0 ms 2023-07-11 20:39:45,250 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:45,251 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:45,251 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 032d0495ec0964438e1a1750441fa9f9: 2023-07-11 20:39:45,251 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 771db035f4c5dc0d7b474b119c9c3a12, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.', STARTKEY => 'fff', ENDKEY => 'ggg'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,329 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,330 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 126966e5d395a2142294de9a3be86ebf, disabling compactions & flushes 2023-07-11 20:39:45,330 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:39:45,330 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:39:45,330 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. after waiting 0 ms 2023-07-11 20:39:45,330 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:39:45,330 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:39:45,330 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 126966e5d395a2142294de9a3be86ebf: 2023-07-11 20:39:45,331 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4e500486342518ff5692418f30fc7f83, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83.', STARTKEY => 'ggg', ENDKEY => 'hhh'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,331 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,331 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 771db035f4c5dc0d7b474b119c9c3a12, disabling compactions & flushes 2023-07-11 20:39:45,331 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:39:45,331 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:39:45,331 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. after waiting 0 ms 2023-07-11 20:39:45,331 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:39:45,331 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:39:45,331 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 771db035f4c5dc0d7b474b119c9c3a12: 2023-07-11 20:39:45,332 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 271710c1c9bb963a3440ef4a722e1452, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452.', STARTKEY => 'hhh', ENDKEY => 'iii'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,335 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,336 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 1f1f55e7b9bb4f716044688e8cde5170, disabling compactions & flushes 2023-07-11 20:39:45,336 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:39:45,337 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:39:45,337 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. after waiting 0 ms 2023-07-11 20:39:45,337 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:39:45,337 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:39:45,337 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 1f1f55e7b9bb4f716044688e8cde5170: 2023-07-11 20:39:45,337 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => ecacbcb0936c91836cd6ad725ff995f7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.', STARTKEY => 'iii', ENDKEY => 'jjj'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:39:45,382 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,390 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 271710c1c9bb963a3440ef4a722e1452, disabling compactions & flushes 2023-07-11 20:39:45,391 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:39:45,391 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:39:45,391 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. after waiting 0 ms 2023-07-11 20:39:45,391 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:39:45,391 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:39:45,391 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 271710c1c9bb963a3440ef4a722e1452: 2023-07-11 20:39:45,391 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => a66eca7e7de9f874fbf8a3b37791f8be, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.', STARTKEY => 'jjj', ENDKEY => 'kkk'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,395 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,395 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing ecacbcb0936c91836cd6ad725ff995f7, disabling compactions & flushes 2023-07-11 20:39:45,395 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:39:45,395 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:39:45,395 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. after waiting 0 ms 2023-07-11 20:39:45,395 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:39:45,396 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:39:45,396 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for ecacbcb0936c91836cd6ad725ff995f7: 2023-07-11 20:39:45,396 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3ad8434b03fda3dc4758a9fb74cfdc5d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.', STARTKEY => 'kkk', ENDKEY => 'lll'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,407 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,410 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 4e500486342518ff5692418f30fc7f83, disabling compactions & flushes 2023-07-11 20:39:45,411 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:39:45,411 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:39:45,411 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. after waiting 0 ms 2023-07-11 20:39:45,411 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:39:45,412 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:39:45,412 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 4e500486342518ff5692418f30fc7f83: 2023-07-11 20:39:45,413 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => fe2b95730f173e86f1c38a731479321f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f.', STARTKEY => 'lll', ENDKEY => 'mmm'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,423 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,424 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing a66eca7e7de9f874fbf8a3b37791f8be, disabling compactions & flushes 2023-07-11 20:39:45,424 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:39:45,424 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:39:45,424 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. after waiting 0 ms 2023-07-11 20:39:45,424 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:39:45,424 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:39:45,424 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for a66eca7e7de9f874fbf8a3b37791f8be: 2023-07-11 20:39:45,425 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 252836bab05fe1e164f33265af5a41a2, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2.', STARTKEY => 'mmm', ENDKEY => 'nnn'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,428 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,430 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 3ad8434b03fda3dc4758a9fb74cfdc5d, disabling compactions & flushes 2023-07-11 20:39:45,430 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:39:45,431 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:39:45,431 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. after waiting 0 ms 2023-07-11 20:39:45,431 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:39:45,431 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:39:45,431 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 3ad8434b03fda3dc4758a9fb74cfdc5d: 2023-07-11 20:39:45,431 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => f8703bfd69cad775e76710af34863a09, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.', STARTKEY => 'nnn', ENDKEY => 'ooo'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,447 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,448 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing fe2b95730f173e86f1c38a731479321f, disabling compactions & flushes 2023-07-11 20:39:45,448 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:39:45,448 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:39:45,448 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. after waiting 0 ms 2023-07-11 20:39:45,448 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:39:45,448 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:39:45,448 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for fe2b95730f173e86f1c38a731479321f: 2023-07-11 20:39:45,449 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 34c7c2230412431453d1e48ace10e600, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600.', STARTKEY => 'ooo', ENDKEY => 'ppp'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,471 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,472 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 252836bab05fe1e164f33265af5a41a2, disabling compactions & flushes 2023-07-11 20:39:45,472 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:39:45,472 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:39:45,473 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. after waiting 1 ms 2023-07-11 20:39:45,473 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:39:45,473 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:39:45,473 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 252836bab05fe1e164f33265af5a41a2: 2023-07-11 20:39:45,473 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => b0ceba1adb699bcddcac5c4ff683a7d5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.', STARTKEY => 'ppp', ENDKEY => 'qqq'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,488 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,489 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing f8703bfd69cad775e76710af34863a09, disabling compactions & flushes 2023-07-11 20:39:45,489 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:39:45,489 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:39:45,489 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. after waiting 0 ms 2023-07-11 20:39:45,489 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:39:45,489 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:39:45,489 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for f8703bfd69cad775e76710af34863a09: 2023-07-11 20:39:45,490 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9996238a94686c4a78ed12dd9da6fbe6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6.', STARTKEY => 'qqq', ENDKEY => 'rrr'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,500 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,500 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 34c7c2230412431453d1e48ace10e600, disabling compactions & flushes 2023-07-11 20:39:45,500 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:39:45,500 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:39:45,501 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. after waiting 0 ms 2023-07-11 20:39:45,501 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:39:45,501 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:39:45,501 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 34c7c2230412431453d1e48ace10e600: 2023-07-11 20:39:45,501 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 950bc72614c9a8a43882ca9374cd68b1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1.', STARTKEY => 'rrr', ENDKEY => 'sss'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,516 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,516 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 9996238a94686c4a78ed12dd9da6fbe6, disabling compactions & flushes 2023-07-11 20:39:45,516 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:39:45,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:39:45,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. after waiting 0 ms 2023-07-11 20:39:45,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:39:45,517 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:39:45,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 9996238a94686c4a78ed12dd9da6fbe6: 2023-07-11 20:39:45,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,518 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing b0ceba1adb699bcddcac5c4ff683a7d5, disabling compactions & flushes 2023-07-11 20:39:45,518 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1c6c57adadf49aca13384cc30abb8442, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442.', STARTKEY => 'sss', ENDKEY => 'ttt'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,518 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:39:45,518 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:39:45,518 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. after waiting 0 ms 2023-07-11 20:39:45,518 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:39:45,518 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:39:45,518 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for b0ceba1adb699bcddcac5c4ff683a7d5: 2023-07-11 20:39:45,519 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec622bf0b15287b4631102fc291dead5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.', STARTKEY => 'ttt', ENDKEY => 'uuu'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,535 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 950bc72614c9a8a43882ca9374cd68b1, disabling compactions & flushes 2023-07-11 20:39:45,536 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:39:45,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:39:45,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. after waiting 0 ms 2023-07-11 20:39:45,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:39:45,536 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:39:45,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 950bc72614c9a8a43882ca9374cd68b1: 2023-07-11 20:39:45,537 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => ef1ae4440e8f6d786a2521b3b820205c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.', STARTKEY => 'uuu', ENDKEY => 'vvv'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,576 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,577 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 1c6c57adadf49aca13384cc30abb8442, disabling compactions & flushes 2023-07-11 20:39:45,577 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:39:45,577 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:39:45,577 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. after waiting 0 ms 2023-07-11 20:39:45,577 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:39:45,577 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:39:45,577 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 1c6c57adadf49aca13384cc30abb8442: 2023-07-11 20:39:45,578 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 8e8a887c1dfba3387c203eaa29970d81, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81.', STARTKEY => 'vvv', ENDKEY => 'www'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,597 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,598 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing ef1ae4440e8f6d786a2521b3b820205c, disabling compactions & flushes 2023-07-11 20:39:45,598 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:39:45,598 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:39:45,598 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. after waiting 0 ms 2023-07-11 20:39:45,598 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:39:45,598 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:39:45,598 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for ef1ae4440e8f6d786a2521b3b820205c: 2023-07-11 20:39:45,598 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => bb68c30b67501f47ae63c14ce057756a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a.', STARTKEY => 'www', ENDKEY => 'xxx'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,624 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,625 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 8e8a887c1dfba3387c203eaa29970d81, disabling compactions & flushes 2023-07-11 20:39:45,625 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:39:45,625 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:39:45,625 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. after waiting 0 ms 2023-07-11 20:39:45,625 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:39:45,625 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:39:45,625 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 8e8a887c1dfba3387c203eaa29970d81: 2023-07-11 20:39:45,625 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9d47696c41005c80caeeaa85fe4aebdf, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.', STARTKEY => 'xxx', ENDKEY => 'yyy'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,626 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,626 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing bb68c30b67501f47ae63c14ce057756a, disabling compactions & flushes 2023-07-11 20:39:45,626 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:39:45,626 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:39:45,626 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. after waiting 0 ms 2023-07-11 20:39:45,626 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:39:45,626 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:39:45,626 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for bb68c30b67501f47ae63c14ce057756a: 2023-07-11 20:39:45,627 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => c3f1f11bb87dbde31c4a80a24b4804cf, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf.', STARTKEY => 'yyy', ENDKEY => 'zzz'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,660 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,662 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 9d47696c41005c80caeeaa85fe4aebdf, disabling compactions & flushes 2023-07-11 20:39:45,662 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:39:45,662 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:39:45,662 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. after waiting 0 ms 2023-07-11 20:39:45,662 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:39:45,662 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:39:45,662 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 9d47696c41005c80caeeaa85fe4aebdf: 2023-07-11 20:39:45,663 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 80ec0d0a545f169fdf6bee237db4b021, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021.', STARTKEY => 'zzz', ENDKEY => ''}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/.tmp 2023-07-11 20:39:45,668 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,668 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing c3f1f11bb87dbde31c4a80a24b4804cf, disabling compactions & flushes 2023-07-11 20:39:45,668 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:39:45,668 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:39:45,669 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. after waiting 0 ms 2023-07-11 20:39:45,669 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:39:45,669 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:39:45,669 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for c3f1f11bb87dbde31c4a80a24b4804cf: 2023-07-11 20:39:45,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:39:45,707 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,707 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 80ec0d0a545f169fdf6bee237db4b021, disabling compactions & flushes 2023-07-11 20:39:45,708 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:39:45,708 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:39:45,708 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. after waiting 0 ms 2023-07-11 20:39:45,708 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:39:45,708 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:39:45,708 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 80ec0d0a545f169fdf6bee237db4b021: 2023-07-11 20:39:45,973 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:45,973 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing ec622bf0b15287b4631102fc291dead5, disabling compactions & flushes 2023-07-11 20:39:45,973 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:39:45,974 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:39:45,974 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. after waiting 0 ms 2023-07-11 20:39:45,974 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:39:45,974 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:39:45,974 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for ec622bf0b15287b4631102fc291dead5: 2023-07-11 20:39:45,980 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:39:45,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:45,986 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107985981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689107985981"}]},"ts":"1689107985981"} 2023-07-11 20:39:46,043 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 26 regions to meta. 2023-07-11 20:39:46,047 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:39:46,047 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689107986047"}]},"ts":"1689107986047"} 2023-07-11 20:39:46,050 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLING in hbase:meta 2023-07-11 20:39:46,055 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:39:46,104 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:39:46,104 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:39:46,104 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:39:46,104 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:39:46,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=032d0495ec0964438e1a1750441fa9f9, ASSIGN}, {pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN}, {pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2ca9cb0f701c87260f2be41ccb924558, ASSIGN}, {pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1f1f55e7b9bb4f716044688e8cde5170, ASSIGN}, {pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=126966e5d395a2142294de9a3be86ebf, ASSIGN}, {pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN}, {pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4e500486342518ff5692418f30fc7f83, ASSIGN}, {pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=271710c1c9bb963a3440ef4a722e1452, ASSIGN}, {pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN}, {pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a66eca7e7de9f874fbf8a3b37791f8be, ASSIGN}, {pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN}, {pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fe2b95730f173e86f1c38a731479321f, ASSIGN}, {pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=252836bab05fe1e164f33265af5a41a2, ASSIGN}, {pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN}, {pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34c7c2230412431453d1e48ace10e600, ASSIGN}, {pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN}, {pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9996238a94686c4a78ed12dd9da6fbe6, ASSIGN}, {pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=950bc72614c9a8a43882ca9374cd68b1, ASSIGN}, {pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1c6c57adadf49aca13384cc30abb8442, ASSIGN}, {pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN}, {pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN}, {pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8e8a887c1dfba3387c203eaa29970d81, ASSIGN}, {pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb68c30b67501f47ae63c14ce057756a, ASSIGN}, {pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN}, {pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c3f1f11bb87dbde31c4a80a24b4804cf, ASSIGN}, {pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=80ec0d0a545f169fdf6bee237db4b021, ASSIGN}] 2023-07-11 20:39:46,116 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=80ec0d0a545f169fdf6bee237db4b021, ASSIGN 2023-07-11 20:39:46,118 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=80ec0d0a545f169fdf6bee237db4b021, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,119 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c3f1f11bb87dbde31c4a80a24b4804cf, ASSIGN 2023-07-11 20:39:46,120 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c3f1f11bb87dbde31c4a80a24b4804cf, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,121 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN 2023-07-11 20:39:46,123 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,124 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb68c30b67501f47ae63c14ce057756a, ASSIGN 2023-07-11 20:39:46,125 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb68c30b67501f47ae63c14ce057756a, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,126 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8e8a887c1dfba3387c203eaa29970d81, ASSIGN 2023-07-11 20:39:46,128 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8e8a887c1dfba3387c203eaa29970d81, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,130 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN 2023-07-11 20:39:46,131 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,132 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN 2023-07-11 20:39:46,133 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,134 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1c6c57adadf49aca13384cc30abb8442, ASSIGN 2023-07-11 20:39:46,135 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1c6c57adadf49aca13384cc30abb8442, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,136 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=950bc72614c9a8a43882ca9374cd68b1, ASSIGN 2023-07-11 20:39:46,137 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=950bc72614c9a8a43882ca9374cd68b1, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,138 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9996238a94686c4a78ed12dd9da6fbe6, ASSIGN 2023-07-11 20:39:46,139 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9996238a94686c4a78ed12dd9da6fbe6, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,140 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN 2023-07-11 20:39:46,141 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,142 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34c7c2230412431453d1e48ace10e600, ASSIGN 2023-07-11 20:39:46,143 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34c7c2230412431453d1e48ace10e600, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,144 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN 2023-07-11 20:39:46,145 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,146 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=252836bab05fe1e164f33265af5a41a2, ASSIGN 2023-07-11 20:39:46,148 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=252836bab05fe1e164f33265af5a41a2, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,150 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fe2b95730f173e86f1c38a731479321f, ASSIGN 2023-07-11 20:39:46,152 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fe2b95730f173e86f1c38a731479321f, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,153 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN 2023-07-11 20:39:46,154 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,155 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a66eca7e7de9f874fbf8a3b37791f8be, ASSIGN 2023-07-11 20:39:46,156 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a66eca7e7de9f874fbf8a3b37791f8be, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,157 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN 2023-07-11 20:39:46,160 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,161 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=271710c1c9bb963a3440ef4a722e1452, ASSIGN 2023-07-11 20:39:46,162 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=271710c1c9bb963a3440ef4a722e1452, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,163 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4e500486342518ff5692418f30fc7f83, ASSIGN 2023-07-11 20:39:46,167 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4e500486342518ff5692418f30fc7f83, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN 2023-07-11 20:39:46,172 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,175 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=126966e5d395a2142294de9a3be86ebf, ASSIGN 2023-07-11 20:39:46,177 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=126966e5d395a2142294de9a3be86ebf, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,178 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1f1f55e7b9bb4f716044688e8cde5170, ASSIGN 2023-07-11 20:39:46,179 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1f1f55e7b9bb4f716044688e8cde5170, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,180 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2ca9cb0f701c87260f2be41ccb924558, ASSIGN 2023-07-11 20:39:46,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:39:46,192 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2ca9cb0f701c87260f2be41ccb924558, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42009,1689107981238; forceNewPlan=false, retain=false 2023-07-11 20:39:46,193 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN 2023-07-11 20:39:46,195 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44935,1689107981188; forceNewPlan=false, retain=false 2023-07-11 20:39:46,197 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=032d0495ec0964438e1a1750441fa9f9, ASSIGN 2023-07-11 20:39:46,198 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=032d0495ec0964438e1a1750441fa9f9, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41489,1689107981112; forceNewPlan=false, retain=false 2023-07-11 20:39:46,268 INFO [jenkins-hbase5:44753] balancer.BaseLoadBalancer(1545): Reassigned 26 regions. 26 retained the pre-restart assignment. 2023-07-11 20:39:46,279 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986279"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986279"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986279"}]},"ts":"1689107986279"} 2023-07-11 20:39:46,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=33, state=RUNNABLE; OpenRegionProcedure 9d47696c41005c80caeeaa85fe4aebdf, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,294 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986294"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986294"}]},"ts":"1689107986294"} 2023-07-11 20:39:46,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=18, state=RUNNABLE; OpenRegionProcedure ecacbcb0936c91836cd6ad725ff995f7, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,312 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986311"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986311"}]},"ts":"1689107986311"} 2023-07-11 20:39:46,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=30, state=RUNNABLE; OpenRegionProcedure ef1ae4440e8f6d786a2521b3b820205c, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,320 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ec622bf0b15287b4631102fc291dead5, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,320 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986320"}]},"ts":"1689107986320"} 2023-07-11 20:39:46,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=29, state=RUNNABLE; OpenRegionProcedure ec622bf0b15287b4631102fc291dead5, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,327 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f8703bfd69cad775e76710af34863a09, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,327 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986327"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986327"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986327"}]},"ts":"1689107986327"} 2023-07-11 20:39:46,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=23, state=RUNNABLE; OpenRegionProcedure f8703bfd69cad775e76710af34863a09, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,342 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e6cc1f00c76bab58b5f481134121b510, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986342"}]},"ts":"1689107986342"} 2023-07-11 20:39:46,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=11, state=RUNNABLE; OpenRegionProcedure e6cc1f00c76bab58b5f481134121b510, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,351 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986351"}]},"ts":"1689107986351"} 2023-07-11 20:39:46,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=20, state=RUNNABLE; OpenRegionProcedure 3ad8434b03fda3dc4758a9fb74cfdc5d, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,361 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,361 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986361"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986361"}]},"ts":"1689107986361"} 2023-07-11 20:39:46,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=25, state=RUNNABLE; OpenRegionProcedure b0ceba1adb699bcddcac5c4ff683a7d5, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,380 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986379"}]},"ts":"1689107986379"} 2023-07-11 20:39:46,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=15, state=RUNNABLE; OpenRegionProcedure 771db035f4c5dc0d7b474b119c9c3a12, server=jenkins-hbase5.apache.org,44935,1689107981188}] 2023-07-11 20:39:46,404 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=252836bab05fe1e164f33265af5a41a2, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,404 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986404"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986404"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986404"}]},"ts":"1689107986404"} 2023-07-11 20:39:46,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=22, state=RUNNABLE; OpenRegionProcedure 252836bab05fe1e164f33265af5a41a2, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,416 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,416 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986416"}]},"ts":"1689107986416"} 2023-07-11 20:39:46,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=26, state=RUNNABLE; OpenRegionProcedure 9996238a94686c4a78ed12dd9da6fbe6, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,425 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=bb68c30b67501f47ae63c14ce057756a, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,425 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986425"}]},"ts":"1689107986425"} 2023-07-11 20:39:46,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=32, state=RUNNABLE; OpenRegionProcedure bb68c30b67501f47ae63c14ce057756a, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,436 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=80ec0d0a545f169fdf6bee237db4b021, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,436 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689107986436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986436"}]},"ts":"1689107986436"} 2023-07-11 20:39:46,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=35, state=RUNNABLE; OpenRegionProcedure 80ec0d0a545f169fdf6bee237db4b021, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,443 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=126966e5d395a2142294de9a3be86ebf, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,443 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986443"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986443"}]},"ts":"1689107986443"} 2023-07-11 20:39:46,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=14, state=RUNNABLE; OpenRegionProcedure 126966e5d395a2142294de9a3be86ebf, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,452 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,452 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986452"}]},"ts":"1689107986452"} 2023-07-11 20:39:46,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=19, state=RUNNABLE; OpenRegionProcedure a66eca7e7de9f874fbf8a3b37791f8be, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,466 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=271710c1c9bb963a3440ef4a722e1452, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,466 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986466"}]},"ts":"1689107986466"} 2023-07-11 20:39:46,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:39:46,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ad8434b03fda3dc4758a9fb74cfdc5d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-11 20:39:46,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=17, state=RUNNABLE; OpenRegionProcedure 271710c1c9bb963a3440ef4a722e1452, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,481 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2ca9cb0f701c87260f2be41ccb924558, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,482 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986481"}]},"ts":"1689107986481"} 2023-07-11 20:39:46,483 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=12, state=RUNNABLE; OpenRegionProcedure 2ca9cb0f701c87260f2be41ccb924558, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,486 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11 2023-07-11 20:39:46,486 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11 2023-07-11 20:39:46,487 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ad8434b03fda3dc4758a9fb74cfdc5d columnFamilyName colfamily11 2023-07-11 20:39:46,488 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(310): Store=3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,489 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,490 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1c6c57adadf49aca13384cc30abb8442, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,493 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986490"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986490"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986490"}]},"ts":"1689107986490"} 2023-07-11 20:39:46,495 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily21 2023-07-11 20:39:46,495 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily21 2023-07-11 20:39:46,495 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ad8434b03fda3dc4758a9fb74cfdc5d columnFamilyName colfamily21 2023-07-11 20:39:46,496 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(310): Store=3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,496 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=28, state=RUNNABLE; OpenRegionProcedure 1c6c57adadf49aca13384cc30abb8442, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:39:46,504 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily31 2023-07-11 20:39:46,504 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily31 2023-07-11 20:39:46,504 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ad8434b03fda3dc4758a9fb74cfdc5d columnFamilyName colfamily31 2023-07-11 20:39:46,505 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(310): Store=3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,508 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=34c7c2230412431453d1e48ace10e600, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,508 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986508"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986508"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986508"}]},"ts":"1689107986508"} 2023-07-11 20:39:46,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=24, state=RUNNABLE; OpenRegionProcedure 34c7c2230412431453d1e48ace10e600, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:39:46,520 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=032d0495ec0964438e1a1750441fa9f9, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,520 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689107986520"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986520"}]},"ts":"1689107986520"} 2023-07-11 20:39:46,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 3ad8434b03fda3dc4758a9fb74cfdc5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74829360, jitterRate=0.11504435539245605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 3ad8434b03fda3dc4758a9fb74cfdc5d: 2023-07-11 20:39:46,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d., pid=42, masterSystemTime=1689107986451 2023-07-11 20:39:46,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=10, state=RUNNABLE; OpenRegionProcedure 032d0495ec0964438e1a1750441fa9f9, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:39:46,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:39:46,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:39:46,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 771db035f4c5dc0d7b474b119c9c3a12, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2023-07-11 20:39:46,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986531"}]},"ts":"1689107986531"} 2023-07-11 20:39:46,532 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,535 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily11 2023-07-11 20:39:46,535 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily11 2023-07-11 20:39:46,536 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 771db035f4c5dc0d7b474b119c9c3a12 columnFamilyName colfamily11 2023-07-11 20:39:46,536 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(310): Store=771db035f4c5dc0d7b474b119c9c3a12/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,537 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=20 2023-07-11 20:39:46,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=20, state=SUCCESS; OpenRegionProcedure 3ad8434b03fda3dc4758a9fb74cfdc5d, server=jenkins-hbase5.apache.org,44935,1689107981188 in 180 msec 2023-07-11 20:39:46,539 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily21 2023-07-11 20:39:46,539 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily21 2023-07-11 20:39:46,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN in 432 msec 2023-07-11 20:39:46,540 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=fe2b95730f173e86f1c38a731479321f, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,540 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 771db035f4c5dc0d7b474b119c9c3a12 columnFamilyName colfamily21 2023-07-11 20:39:46,540 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986540"}]},"ts":"1689107986540"} 2023-07-11 20:39:46,541 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(310): Store=771db035f4c5dc0d7b474b119c9c3a12/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,541 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=21, state=RUNNABLE; OpenRegionProcedure fe2b95730f173e86f1c38a731479321f, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,543 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily31 2023-07-11 20:39:46,543 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily31 2023-07-11 20:39:46,544 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 771db035f4c5dc0d7b474b119c9c3a12 columnFamilyName colfamily31 2023-07-11 20:39:46,545 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(310): Store=771db035f4c5dc0d7b474b119c9c3a12/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,548 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,548 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986548"}]},"ts":"1689107986548"} 2023-07-11 20:39:46,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=34, state=RUNNABLE; OpenRegionProcedure c3f1f11bb87dbde31c4a80a24b4804cf, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:39:46,558 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4e500486342518ff5692418f30fc7f83, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,558 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986558"}]},"ts":"1689107986558"} 2023-07-11 20:39:46,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 771db035f4c5dc0d7b474b119c9c3a12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67512770, jitterRate=0.0060186684131622314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 771db035f4c5dc0d7b474b119c9c3a12: 2023-07-11 20:39:46,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12., pid=44, masterSystemTime=1689107986451 2023-07-11 20:39:46,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=16, state=RUNNABLE; OpenRegionProcedure 4e500486342518ff5692418f30fc7f83, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,565 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,566 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:39:46,570 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:39:46,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:39:46,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:39:46,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:39:46,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecacbcb0936c91836cd6ad725ff995f7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-11 20:39:46,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,576 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,576 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986576"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986576"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986576"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986576"}]},"ts":"1689107986576"} 2023-07-11 20:39:46,577 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:39:46,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80ec0d0a545f169fdf6bee237db4b021, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-11 20:39:46,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,581 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily11 2023-07-11 20:39:46,581 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily11 2023-07-11 20:39:46,581 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecacbcb0936c91836cd6ad725ff995f7 columnFamilyName colfamily11 2023-07-11 20:39:46,582 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,582 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(310): Store=ecacbcb0936c91836cd6ad725ff995f7/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,582 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,585 DEBUG [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily11 2023-07-11 20:39:46,585 DEBUG [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily11 2023-07-11 20:39:46,586 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily21 2023-07-11 20:39:46,586 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily21 2023-07-11 20:39:46,587 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80ec0d0a545f169fdf6bee237db4b021 columnFamilyName colfamily11 2023-07-11 20:39:46,587 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecacbcb0936c91836cd6ad725ff995f7 columnFamilyName colfamily21 2023-07-11 20:39:46,589 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] regionserver.HStore(310): Store=80ec0d0a545f169fdf6bee237db4b021/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=15 2023-07-11 20:39:46,589 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=15, state=SUCCESS; OpenRegionProcedure 771db035f4c5dc0d7b474b119c9c3a12, server=jenkins-hbase5.apache.org,44935,1689107981188 in 198 msec 2023-07-11 20:39:46,589 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(310): Store=ecacbcb0936c91836cd6ad725ff995f7/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,589 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN in 484 msec 2023-07-11 20:39:46,592 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=8e8a887c1dfba3387c203eaa29970d81, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,592 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986592"}]},"ts":"1689107986592"} 2023-07-11 20:39:46,592 DEBUG [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily21 2023-07-11 20:39:46,592 DEBUG [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily21 2023-07-11 20:39:46,592 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily31 2023-07-11 20:39:46,592 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily31 2023-07-11 20:39:46,593 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80ec0d0a545f169fdf6bee237db4b021 columnFamilyName colfamily21 2023-07-11 20:39:46,593 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecacbcb0936c91836cd6ad725ff995f7 columnFamilyName colfamily31 2023-07-11 20:39:46,594 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] regionserver.HStore(310): Store=80ec0d0a545f169fdf6bee237db4b021/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,594 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(310): Store=ecacbcb0936c91836cd6ad725ff995f7/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,594 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=59, ppid=31, state=RUNNABLE; OpenRegionProcedure 8e8a887c1dfba3387c203eaa29970d81, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,598 DEBUG [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily31 2023-07-11 20:39:46,599 DEBUG [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily31 2023-07-11 20:39:46,600 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80ec0d0a545f169fdf6bee237db4b021 columnFamilyName colfamily31 2023-07-11 20:39:46,600 INFO [StoreOpener-80ec0d0a545f169fdf6bee237db4b021-1] regionserver.HStore(310): Store=80ec0d0a545f169fdf6bee237db4b021/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,604 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,605 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986604"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986604"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986604"}]},"ts":"1689107986604"} 2023-07-11 20:39:46,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:39:46,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=13, state=RUNNABLE; OpenRegionProcedure 1f1f55e7b9bb4f716044688e8cde5170, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ecacbcb0936c91836cd6ad725ff995f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74698969, jitterRate=0.11310137808322906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ecacbcb0936c91836cd6ad725ff995f7: 2023-07-11 20:39:46,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:39:46,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7., pid=37, masterSystemTime=1689107986451 2023-07-11 20:39:46,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:39:46,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:39:46,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:46,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6cc1f00c76bab58b5f481134121b510, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-11 20:39:46,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,622 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,622 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986622"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986622"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986622"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986622"}]},"ts":"1689107986622"} 2023-07-11 20:39:46,638 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 80ec0d0a545f169fdf6bee237db4b021; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73769957, jitterRate=0.09925802052021027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 80ec0d0a545f169fdf6bee237db4b021: 2023-07-11 20:39:46,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=18 2023-07-11 20:39:46,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=18, state=SUCCESS; OpenRegionProcedure ecacbcb0936c91836cd6ad725ff995f7, server=jenkins-hbase5.apache.org,44935,1689107981188 in 324 msec 2023-07-11 20:39:46,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021., pid=48, masterSystemTime=1689107986565 2023-07-11 20:39:46,650 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily11 2023-07-11 20:39:46,657 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily11 2023-07-11 20:39:46,657 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6cc1f00c76bab58b5f481134121b510 columnFamilyName colfamily11 2023-07-11 20:39:46,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN in 542 msec 2023-07-11 20:39:46,659 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=950bc72614c9a8a43882ca9374cd68b1, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,659 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986659"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689107986659"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689107986659"}]},"ts":"1689107986659"} 2023-07-11 20:39:46,660 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(310): Store=e6cc1f00c76bab58b5f481134121b510/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:39:46,661 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:39:46,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:39:46,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 126966e5d395a2142294de9a3be86ebf, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-11 20:39:46,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=27, state=RUNNABLE; OpenRegionProcedure 950bc72614c9a8a43882ca9374cd68b1, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:39:46,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,667 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily21 2023-07-11 20:39:46,667 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily21 2023-07-11 20:39:46,669 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6cc1f00c76bab58b5f481134121b510 columnFamilyName colfamily21 2023-07-11 20:39:46,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=80ec0d0a545f169fdf6bee237db4b021, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689107986670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986670"}]},"ts":"1689107986670"} 2023-07-11 20:39:46,671 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,672 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(310): Store=e6cc1f00c76bab58b5f481134121b510/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,672 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,674 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily31 2023-07-11 20:39:46,675 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily31 2023-07-11 20:39:46,676 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6cc1f00c76bab58b5f481134121b510 columnFamilyName colfamily31 2023-07-11 20:39:46,676 DEBUG [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily11 2023-07-11 20:39:46,676 DEBUG [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily11 2023-07-11 20:39:46,677 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(310): Store=e6cc1f00c76bab58b5f481134121b510/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,677 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,677 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 126966e5d395a2142294de9a3be86ebf columnFamilyName colfamily11 2023-07-11 20:39:46,677 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:39:46,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,679 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] regionserver.HStore(310): Store=126966e5d395a2142294de9a3be86ebf/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,679 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,684 DEBUG [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily21 2023-07-11 20:39:46,684 DEBUG [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily21 2023-07-11 20:39:46,684 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 126966e5d395a2142294de9a3be86ebf columnFamilyName colfamily21 2023-07-11 20:39:46,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=35 2023-07-11 20:39:46,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=35, state=SUCCESS; OpenRegionProcedure 80ec0d0a545f169fdf6bee237db4b021, server=jenkins-hbase5.apache.org,42009,1689107981238 in 240 msec 2023-07-11 20:39:46,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,686 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] regionserver.HStore(310): Store=126966e5d395a2142294de9a3be86ebf/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,686 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=80ec0d0a545f169fdf6bee237db4b021, ASSIGN in 578 msec 2023-07-11 20:39:46,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:39:46,695 DEBUG [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily31 2023-07-11 20:39:46,697 DEBUG [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily31 2023-07-11 20:39:46,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,698 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:39:46,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened e6cc1f00c76bab58b5f481134121b510; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69217687, jitterRate=0.031423911452293396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for e6cc1f00c76bab58b5f481134121b510: 2023-07-11 20:39:46,700 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 126966e5d395a2142294de9a3be86ebf columnFamilyName colfamily31 2023-07-11 20:39:46,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510., pid=41, masterSystemTime=1689107986451 2023-07-11 20:39:46,702 INFO [StoreOpener-126966e5d395a2142294de9a3be86ebf-1] regionserver.HStore(310): Store=126966e5d395a2142294de9a3be86ebf/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:39:46,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:46,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:46,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:39:46,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b0ceba1adb699bcddcac5c4ff683a7d5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-11 20:39:46,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,717 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,717 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986717"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986717"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986717"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986717"}]},"ts":"1689107986717"} 2023-07-11 20:39:46,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=11 2023-07-11 20:39:46,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=11, state=SUCCESS; OpenRegionProcedure e6cc1f00c76bab58b5f481134121b510, server=jenkins-hbase5.apache.org,44935,1689107981188 in 379 msec 2023-07-11 20:39:46,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN in 627 msec 2023-07-11 20:39:46,739 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:46,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 032d0495ec0964438e1a1750441fa9f9, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-11 20:39:46,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 126966e5d395a2142294de9a3be86ebf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71133656, jitterRate=0.059974074363708496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 126966e5d395a2142294de9a3be86ebf: 2023-07-11 20:39:46,745 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11 2023-07-11 20:39:46,745 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11 2023-07-11 20:39:46,746 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0ceba1adb699bcddcac5c4ff683a7d5 columnFamilyName colfamily11 2023-07-11 20:39:46,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf., pid=49, masterSystemTime=1689107986565 2023-07-11 20:39:46,747 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(310): Store=b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,747 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:39:46,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:39:46,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:39:46,749 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily21 2023-07-11 20:39:46,750 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily21 2023-07-11 20:39:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c6c57adadf49aca13384cc30abb8442, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-11 20:39:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,750 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0ceba1adb699bcddcac5c4ff683a7d5 columnFamilyName colfamily21 2023-07-11 20:39:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,750 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=126966e5d395a2142294de9a3be86ebf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986750"}]},"ts":"1689107986750"} 2023-07-11 20:39:46,751 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(310): Store=b0ceba1adb699bcddcac5c4ff683a7d5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,751 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,756 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily31 2023-07-11 20:39:46,756 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily31 2023-07-11 20:39:46,756 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0ceba1adb699bcddcac5c4ff683a7d5 columnFamilyName colfamily31 2023-07-11 20:39:46,757 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(310): Store=b0ceba1adb699bcddcac5c4ff683a7d5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,758 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=14 2023-07-11 20:39:46,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=14, state=SUCCESS; OpenRegionProcedure 126966e5d395a2142294de9a3be86ebf, server=jenkins-hbase5.apache.org,42009,1689107981238 in 308 msec 2023-07-11 20:39:46,765 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=126966e5d395a2142294de9a3be86ebf, ASSIGN in 657 msec 2023-07-11 20:39:46,769 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,770 DEBUG [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily11 2023-07-11 20:39:46,770 DEBUG [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily11 2023-07-11 20:39:46,771 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 032d0495ec0964438e1a1750441fa9f9 columnFamilyName colfamily11 2023-07-11 20:39:46,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,773 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] regionserver.HStore(310): Store=032d0495ec0964438e1a1750441fa9f9/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,773 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,775 DEBUG [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily11 2023-07-11 20:39:46,775 DEBUG [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily11 2023-07-11 20:39:46,775 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6c57adadf49aca13384cc30abb8442 columnFamilyName colfamily11 2023-07-11 20:39:46,776 DEBUG [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily21 2023-07-11 20:39:46,776 DEBUG [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily21 2023-07-11 20:39:46,776 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] regionserver.HStore(310): Store=1c6c57adadf49aca13384cc30abb8442/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,777 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,777 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 032d0495ec0964438e1a1750441fa9f9 columnFamilyName colfamily21 2023-07-11 20:39:46,778 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] regionserver.HStore(310): Store=032d0495ec0964438e1a1750441fa9f9/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,778 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,779 DEBUG [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily21 2023-07-11 20:39:46,779 DEBUG [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily21 2023-07-11 20:39:46,780 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6c57adadf49aca13384cc30abb8442 columnFamilyName colfamily21 2023-07-11 20:39:46,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,781 DEBUG [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily31 2023-07-11 20:39:46,781 DEBUG [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily31 2023-07-11 20:39:46,782 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 032d0495ec0964438e1a1750441fa9f9 columnFamilyName colfamily31 2023-07-11 20:39:46,782 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] regionserver.HStore(310): Store=1c6c57adadf49aca13384cc30abb8442/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:39:46,783 INFO [StoreOpener-032d0495ec0964438e1a1750441fa9f9-1] regionserver.HStore(310): Store=032d0495ec0964438e1a1750441fa9f9/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,784 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:39:46,804 DEBUG [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily31 2023-07-11 20:39:46,804 DEBUG [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily31 2023-07-11 20:39:46,805 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6c57adadf49aca13384cc30abb8442 columnFamilyName colfamily31 2023-07-11 20:39:46,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,814 INFO [StoreOpener-1c6c57adadf49aca13384cc30abb8442-1] regionserver.HStore(310): Store=1c6c57adadf49aca13384cc30abb8442/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened b0ceba1adb699bcddcac5c4ff683a7d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62222133, jitterRate=-0.07281796634197235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for b0ceba1adb699bcddcac5c4ff683a7d5: 2023-07-11 20:39:46,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 032d0495ec0964438e1a1750441fa9f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67660032, jitterRate=0.008213043212890625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5., pid=43, masterSystemTime=1689107986451 2023-07-11 20:39:46,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 032d0495ec0964438e1a1750441fa9f9: 2023-07-11 20:39:46,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9., pid=55, masterSystemTime=1689107986677 2023-07-11 20:39:46,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:39:46,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:39:46,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:39:46,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef1ae4440e8f6d786a2521b3b820205c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-11 20:39:46,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,834 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986834"}]},"ts":"1689107986834"} 2023-07-11 20:39:46,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:39:46,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:46,846 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=25 2023-07-11 20:39:46,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=25, state=SUCCESS; OpenRegionProcedure b0ceba1adb699bcddcac5c4ff683a7d5, server=jenkins-hbase5.apache.org,44935,1689107981188 in 475 msec 2023-07-11 20:39:46,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN in 741 msec 2023-07-11 20:39:46,852 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=032d0495ec0964438e1a1750441fa9f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,854 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689107986852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986852"}]},"ts":"1689107986852"} 2023-07-11 20:39:46,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:46,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:39:46,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 950bc72614c9a8a43882ca9374cd68b1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2023-07-11 20:39:46,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,864 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily11 2023-07-11 20:39:46,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1c6c57adadf49aca13384cc30abb8442; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67545547, jitterRate=0.006507083773612976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,865 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily11 2023-07-11 20:39:46,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1c6c57adadf49aca13384cc30abb8442: 2023-07-11 20:39:46,865 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef1ae4440e8f6d786a2521b3b820205c columnFamilyName colfamily11 2023-07-11 20:39:46,866 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(310): Store=ef1ae4440e8f6d786a2521b3b820205c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,866 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442., pid=53, masterSystemTime=1689107986565 2023-07-11 20:39:46,869 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily21 2023-07-11 20:39:46,869 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily21 2023-07-11 20:39:46,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:39:46,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:39:46,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:39:46,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 252836bab05fe1e164f33265af5a41a2, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-11 20:39:46,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,875 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef1ae4440e8f6d786a2521b3b820205c columnFamilyName colfamily21 2023-07-11 20:39:46,876 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(310): Store=ef1ae4440e8f6d786a2521b3b820205c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,877 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,879 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily31 2023-07-11 20:39:46,879 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily31 2023-07-11 20:39:46,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=10 2023-07-11 20:39:46,879 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=10, state=SUCCESS; OpenRegionProcedure 032d0495ec0964438e1a1750441fa9f9, server=jenkins-hbase5.apache.org,41489,1689107981112 in 341 msec 2023-07-11 20:39:46,880 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef1ae4440e8f6d786a2521b3b820205c columnFamilyName colfamily31 2023-07-11 20:39:46,883 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(310): Store=ef1ae4440e8f6d786a2521b3b820205c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=032d0495ec0964438e1a1750441fa9f9, ASSIGN in 777 msec 2023-07-11 20:39:46,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1c6c57adadf49aca13384cc30abb8442, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986888"}]},"ts":"1689107986888"} 2023-07-11 20:39:46,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,895 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,896 DEBUG [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily11 2023-07-11 20:39:46,896 DEBUG [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily11 2023-07-11 20:39:46,896 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 950bc72614c9a8a43882ca9374cd68b1 columnFamilyName colfamily11 2023-07-11 20:39:46,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,899 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] regionserver.HStore(310): Store=950bc72614c9a8a43882ca9374cd68b1/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,899 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,900 DEBUG [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily11 2023-07-11 20:39:46,900 DEBUG [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily11 2023-07-11 20:39:46,900 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 252836bab05fe1e164f33265af5a41a2 columnFamilyName colfamily11 2023-07-11 20:39:46,901 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] regionserver.HStore(310): Store=252836bab05fe1e164f33265af5a41a2/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,902 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,902 DEBUG [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily21 2023-07-11 20:39:46,902 DEBUG [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily21 2023-07-11 20:39:46,902 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 950bc72614c9a8a43882ca9374cd68b1 columnFamilyName colfamily21 2023-07-11 20:39:46,904 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] regionserver.HStore(310): Store=950bc72614c9a8a43882ca9374cd68b1/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,904 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,906 DEBUG [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily31 2023-07-11 20:39:46,907 DEBUG [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily31 2023-07-11 20:39:46,907 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 950bc72614c9a8a43882ca9374cd68b1 columnFamilyName colfamily31 2023-07-11 20:39:46,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:39:46,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=28 2023-07-11 20:39:46,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=28, state=SUCCESS; OpenRegionProcedure 1c6c57adadf49aca13384cc30abb8442, server=jenkins-hbase5.apache.org,42009,1689107981238 in 399 msec 2023-07-11 20:39:46,909 INFO [StoreOpener-950bc72614c9a8a43882ca9374cd68b1-1] regionserver.HStore(310): Store=950bc72614c9a8a43882ca9374cd68b1/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,910 DEBUG [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily21 2023-07-11 20:39:46,910 DEBUG [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily21 2023-07-11 20:39:46,920 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 252836bab05fe1e164f33265af5a41a2 columnFamilyName colfamily21 2023-07-11 20:39:46,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,936 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] regionserver.HStore(310): Store=252836bab05fe1e164f33265af5a41a2/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,936 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ef1ae4440e8f6d786a2521b3b820205c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70226468, jitterRate=0.04645591974258423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ef1ae4440e8f6d786a2521b3b820205c: 2023-07-11 20:39:46,940 DEBUG [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily31 2023-07-11 20:39:46,940 DEBUG [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily31 2023-07-11 20:39:46,941 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 252836bab05fe1e164f33265af5a41a2 columnFamilyName colfamily31 2023-07-11 20:39:46,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c., pid=38, masterSystemTime=1689107986451 2023-07-11 20:39:46,942 INFO [StoreOpener-252836bab05fe1e164f33265af5a41a2-1] regionserver.HStore(310): Store=252836bab05fe1e164f33265af5a41a2/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1c6c57adadf49aca13384cc30abb8442, ASSIGN in 802 msec 2023-07-11 20:39:46,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:39:46,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:39:46,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:39:46,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:39:46,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d47696c41005c80caeeaa85fe4aebdf, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-11 20:39:46,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:46,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:46,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:46,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:46,951 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986950"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986950"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986950"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986950"}]},"ts":"1689107986950"} 2023-07-11 20:39:46,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:46,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:39:46,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=30 2023-07-11 20:39:46,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=30, state=SUCCESS; OpenRegionProcedure ef1ae4440e8f6d786a2521b3b820205c, server=jenkins-hbase5.apache.org,44935,1689107981188 in 642 msec 2023-07-11 20:39:46,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:46,967 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:46,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 252836bab05fe1e164f33265af5a41a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67255238, jitterRate=0.002181142568588257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 950bc72614c9a8a43882ca9374cd68b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69377099, jitterRate=0.03379933536052704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:46,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 252836bab05fe1e164f33265af5a41a2: 2023-07-11 20:39:46,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 950bc72614c9a8a43882ca9374cd68b1: 2023-07-11 20:39:46,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2., pid=45, masterSystemTime=1689107986565 2023-07-11 20:39:46,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1., pid=61, masterSystemTime=1689107986677 2023-07-11 20:39:46,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN in 857 msec 2023-07-11 20:39:46,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:39:46,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:39:46,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:46,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ca9cb0f701c87260f2be41ccb924558, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-11 20:39:46,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:46,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:46,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:46,975 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=252836bab05fe1e164f33265af5a41a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:46,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:39:46,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:39:46,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:39:46,975 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986975"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986975"}]},"ts":"1689107986975"} 2023-07-11 20:39:46,976 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily11 2023-07-11 20:39:46,976 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily11 2023-07-11 20:39:46,975 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:46,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e500486342518ff5692418f30fc7f83, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2023-07-11 20:39:46,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:46,976 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d47696c41005c80caeeaa85fe4aebdf columnFamilyName colfamily11 2023-07-11 20:39:46,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:46,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:46,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:46,978 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(310): Store=9d47696c41005c80caeeaa85fe4aebdf/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,978 DEBUG [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily11 2023-07-11 20:39:46,978 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:46,978 DEBUG [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily11 2023-07-11 20:39:46,979 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ca9cb0f701c87260f2be41ccb924558 columnFamilyName colfamily11 2023-07-11 20:39:46,981 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily21 2023-07-11 20:39:46,981 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily21 2023-07-11 20:39:46,981 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d47696c41005c80caeeaa85fe4aebdf columnFamilyName colfamily21 2023-07-11 20:39:46,981 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] regionserver.HStore(310): Store=2ca9cb0f701c87260f2be41ccb924558/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,982 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:46,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=22 2023-07-11 20:39:46,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=22, state=SUCCESS; OpenRegionProcedure 252836bab05fe1e164f33265af5a41a2, server=jenkins-hbase5.apache.org,42009,1689107981238 in 572 msec 2023-07-11 20:39:46,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=252836bab05fe1e164f33265af5a41a2, ASSIGN in 879 msec 2023-07-11 20:39:46,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=950bc72614c9a8a43882ca9374cd68b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:46,987 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107986986"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107986986"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107986986"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107986986"}]},"ts":"1689107986986"} 2023-07-11 20:39:46,987 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(310): Store=9d47696c41005c80caeeaa85fe4aebdf/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,987 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:46,990 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily31 2023-07-11 20:39:46,990 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily31 2023-07-11 20:39:46,991 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d47696c41005c80caeeaa85fe4aebdf columnFamilyName colfamily31 2023-07-11 20:39:46,992 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(310): Store=9d47696c41005c80caeeaa85fe4aebdf/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,992 DEBUG [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily21 2023-07-11 20:39:46,992 DEBUG [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily21 2023-07-11 20:39:46,993 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ca9cb0f701c87260f2be41ccb924558 columnFamilyName colfamily21 2023-07-11 20:39:46,994 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] regionserver.HStore(310): Store=2ca9cb0f701c87260f2be41ccb924558/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:46,994 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:46,999 DEBUG [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily31 2023-07-11 20:39:46,999 DEBUG [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily31 2023-07-11 20:39:47,000 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ca9cb0f701c87260f2be41ccb924558 columnFamilyName colfamily31 2023-07-11 20:39:47,001 INFO [StoreOpener-2ca9cb0f701c87260f2be41ccb924558-1] regionserver.HStore(310): Store=2ca9cb0f701c87260f2be41ccb924558/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,009 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:47,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:47,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:47,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:47,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:47,014 DEBUG [StoreOpener-4e500486342518ff5692418f30fc7f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily11 2023-07-11 20:39:47,014 DEBUG [StoreOpener-4e500486342518ff5692418f30fc7f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily11 2023-07-11 20:39:47,015 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e500486342518ff5692418f30fc7f83 columnFamilyName colfamily11 2023-07-11 20:39:47,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,016 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] regionserver.HStore(310): Store=4e500486342518ff5692418f30fc7f83/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,016 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:47,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:39:47,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:39:47,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=27 2023-07-11 20:39:47,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=27, state=SUCCESS; OpenRegionProcedure 950bc72614c9a8a43882ca9374cd68b1, server=jenkins-hbase5.apache.org,41489,1689107981112 in 347 msec 2023-07-11 20:39:47,020 DEBUG [StoreOpener-4e500486342518ff5692418f30fc7f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily21 2023-07-11 20:39:47,020 DEBUG [StoreOpener-4e500486342518ff5692418f30fc7f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily21 2023-07-11 20:39:47,021 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e500486342518ff5692418f30fc7f83 columnFamilyName colfamily21 2023-07-11 20:39:47,022 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] regionserver.HStore(310): Store=4e500486342518ff5692418f30fc7f83/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=950bc72614c9a8a43882ca9374cd68b1, ASSIGN in 912 msec 2023-07-11 20:39:47,022 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:47,024 DEBUG [StoreOpener-4e500486342518ff5692418f30fc7f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily31 2023-07-11 20:39:47,024 DEBUG [StoreOpener-4e500486342518ff5692418f30fc7f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily31 2023-07-11 20:39:47,025 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e500486342518ff5692418f30fc7f83 columnFamilyName colfamily31 2023-07-11 20:39:47,026 INFO [StoreOpener-4e500486342518ff5692418f30fc7f83-1] regionserver.HStore(310): Store=4e500486342518ff5692418f30fc7f83/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 2ca9cb0f701c87260f2be41ccb924558; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69738656, jitterRate=0.039186954498291016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 2ca9cb0f701c87260f2be41ccb924558: 2023-07-11 20:39:47,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:47,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:47,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 9d47696c41005c80caeeaa85fe4aebdf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70301991, jitterRate=0.047581300139427185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 9d47696c41005c80caeeaa85fe4aebdf: 2023-07-11 20:39:47,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558., pid=52, masterSystemTime=1689107986565 2023-07-11 20:39:47,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf., pid=36, masterSystemTime=1689107986451 2023-07-11 20:39:47,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 4e500486342518ff5692418f30fc7f83 2023-07-11 20:39:47,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:47,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:47,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:39:47,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 271710c1c9bb963a3440ef4a722e1452, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2023-07-11 20:39:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:39:47,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:39:47,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:39:47,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8703bfd69cad775e76710af34863a09, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-11 20:39:47,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,051 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2ca9cb0f701c87260f2be41ccb924558, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:47,052 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987051"}]},"ts":"1689107987051"} 2023-07-11 20:39:47,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,055 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 4e500486342518ff5692418f30fc7f83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67735999, jitterRate=0.00934503972530365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 4e500486342518ff5692418f30fc7f83: 2023-07-11 20:39:47,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83., pid=58, masterSystemTime=1689107986677 2023-07-11 20:39:47,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:39:47,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:39:47,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:39:47,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34c7c2230412431453d1e48ace10e600, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2023-07-11 20:39:47,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=12 2023-07-11 20:39:47,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=12, state=SUCCESS; OpenRegionProcedure 2ca9cb0f701c87260f2be41ccb924558, server=jenkins-hbase5.apache.org,42009,1689107981238 in 571 msec 2023-07-11 20:39:47,069 DEBUG [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily11 2023-07-11 20:39:47,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2ca9cb0f701c87260f2be41ccb924558, ASSIGN in 959 msec 2023-07-11 20:39:47,069 DEBUG [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily11 2023-07-11 20:39:47,072 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 271710c1c9bb963a3440ef4a722e1452 columnFamilyName colfamily11 2023-07-11 20:39:47,075 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,076 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4e500486342518ff5692418f30fc7f83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:47,076 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,076 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987075"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987075"}]},"ts":"1689107987075"} 2023-07-11 20:39:47,077 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily11 2023-07-11 20:39:47,077 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily11 2023-07-11 20:39:47,078 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8703bfd69cad775e76710af34863a09 columnFamilyName colfamily11 2023-07-11 20:39:47,078 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] regionserver.HStore(310): Store=271710c1c9bb963a3440ef4a722e1452/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,078 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(310): Store=f8703bfd69cad775e76710af34863a09/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,079 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,079 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,081 DEBUG [StoreOpener-34c7c2230412431453d1e48ace10e600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily11 2023-07-11 20:39:47,081 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily21 2023-07-11 20:39:47,081 DEBUG [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily21 2023-07-11 20:39:47,082 DEBUG [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily21 2023-07-11 20:39:47,081 DEBUG [StoreOpener-34c7c2230412431453d1e48ace10e600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily11 2023-07-11 20:39:47,082 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily21 2023-07-11 20:39:47,082 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 271710c1c9bb963a3440ef4a722e1452 columnFamilyName colfamily21 2023-07-11 20:39:47,082 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34c7c2230412431453d1e48ace10e600 columnFamilyName colfamily11 2023-07-11 20:39:47,082 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8703bfd69cad775e76710af34863a09 columnFamilyName colfamily21 2023-07-11 20:39:47,083 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] regionserver.HStore(310): Store=271710c1c9bb963a3440ef4a722e1452/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,083 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(310): Store=f8703bfd69cad775e76710af34863a09/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,083 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] regionserver.HStore(310): Store=34c7c2230412431453d1e48ace10e600/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,083 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,083 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,084 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=16 2023-07-11 20:39:47,086 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily31 2023-07-11 20:39:47,086 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily31 2023-07-11 20:39:47,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=16, state=SUCCESS; OpenRegionProcedure 4e500486342518ff5692418f30fc7f83, server=jenkins-hbase5.apache.org,41489,1689107981112 in 520 msec 2023-07-11 20:39:47,086 DEBUG [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily31 2023-07-11 20:39:47,086 DEBUG [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily31 2023-07-11 20:39:47,086 DEBUG [StoreOpener-34c7c2230412431453d1e48ace10e600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily21 2023-07-11 20:39:47,086 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8703bfd69cad775e76710af34863a09 columnFamilyName colfamily31 2023-07-11 20:39:47,086 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 271710c1c9bb963a3440ef4a722e1452 columnFamilyName colfamily31 2023-07-11 20:39:47,086 DEBUG [StoreOpener-34c7c2230412431453d1e48ace10e600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily21 2023-07-11 20:39:47,087 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(310): Store=f8703bfd69cad775e76710af34863a09/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,087 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34c7c2230412431453d1e48ace10e600 columnFamilyName colfamily21 2023-07-11 20:39:47,088 INFO [StoreOpener-271710c1c9bb963a3440ef4a722e1452-1] regionserver.HStore(310): Store=271710c1c9bb963a3440ef4a722e1452/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,089 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] regionserver.HStore(310): Store=34c7c2230412431453d1e48ace10e600/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,089 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4e500486342518ff5692418f30fc7f83, ASSIGN in 981 msec 2023-07-11 20:39:47,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,093 DEBUG [StoreOpener-34c7c2230412431453d1e48ace10e600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily31 2023-07-11 20:39:47,093 DEBUG [StoreOpener-34c7c2230412431453d1e48ace10e600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily31 2023-07-11 20:39:47,095 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34c7c2230412431453d1e48ace10e600 columnFamilyName colfamily31 2023-07-11 20:39:47,096 INFO [StoreOpener-34c7c2230412431453d1e48ace10e600-1] regionserver.HStore(310): Store=34c7c2230412431453d1e48ace10e600/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,100 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:47,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,101 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987100"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987100"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987100"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987100"}]},"ts":"1689107987100"} 2023-07-11 20:39:47,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:39:47,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for f8703bfd69cad775e76710af34863a09 2023-07-11 20:39:47,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-07-11 20:39:47,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; OpenRegionProcedure 9d47696c41005c80caeeaa85fe4aebdf, server=jenkins-hbase5.apache.org,44935,1689107981188 in 820 msec 2023-07-11 20:39:47,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 34c7c2230412431453d1e48ace10e600 2023-07-11 20:39:47,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN in 1.0000 sec 2023-07-11 20:39:47,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 271710c1c9bb963a3440ef4a722e1452; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68288233, jitterRate=0.017573967576026917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened f8703bfd69cad775e76710af34863a09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73788261, jitterRate=0.09953077137470245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for f8703bfd69cad775e76710af34863a09: 2023-07-11 20:39:47,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 271710c1c9bb963a3440ef4a722e1452: 2023-07-11 20:39:47,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 34c7c2230412431453d1e48ace10e600; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58732662, jitterRate=-0.12481513619422913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 34c7c2230412431453d1e48ace10e600: 2023-07-11 20:39:47,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452., pid=51, masterSystemTime=1689107986565 2023-07-11 20:39:47,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09., pid=40, masterSystemTime=1689107986451 2023-07-11 20:39:47,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600., pid=54, masterSystemTime=1689107986677 2023-07-11 20:39:47,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:39:47,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:39:47,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:39:47,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec622bf0b15287b4631102fc291dead5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-11 20:39:47,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:39:47,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:39:47,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:39:47,128 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f8703bfd69cad775e76710af34863a09, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:47,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9996238a94686c4a78ed12dd9da6fbe6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-11 20:39:47,129 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987128"}]},"ts":"1689107987128"} 2023-07-11 20:39:47,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,131 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:39:47,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:39:47,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:39:47,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f1f55e7b9bb4f716044688e8cde5170, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-11 20:39:47,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=23 2023-07-11 20:39:47,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=23, state=SUCCESS; OpenRegionProcedure f8703bfd69cad775e76710af34863a09, server=jenkins-hbase5.apache.org,44935,1689107981188 in 803 msec 2023-07-11 20:39:47,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN in 1.0310 sec 2023-07-11 20:39:47,138 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=34c7c2230412431453d1e48ace10e600, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:47,139 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987139"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987139"}]},"ts":"1689107987139"} 2023-07-11 20:39:47,140 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily11 2023-07-11 20:39:47,140 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily11 2023-07-11 20:39:47,140 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec622bf0b15287b4631102fc291dead5 columnFamilyName colfamily11 2023-07-11 20:39:47,142 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(310): Store=ec622bf0b15287b4631102fc291dead5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,142 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=24 2023-07-11 20:39:47,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=24, state=SUCCESS; OpenRegionProcedure 34c7c2230412431453d1e48ace10e600, server=jenkins-hbase5.apache.org,41489,1689107981112 in 627 msec 2023-07-11 20:39:47,146 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,147 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily21 2023-07-11 20:39:47,148 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily21 2023-07-11 20:39:47,147 DEBUG [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily11 2023-07-11 20:39:47,148 DEBUG [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily11 2023-07-11 20:39:47,148 DEBUG [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily11 2023-07-11 20:39:47,148 DEBUG [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily11 2023-07-11 20:39:47,149 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9996238a94686c4a78ed12dd9da6fbe6 columnFamilyName colfamily11 2023-07-11 20:39:47,149 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f1f55e7b9bb4f716044688e8cde5170 columnFamilyName colfamily11 2023-07-11 20:39:47,149 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec622bf0b15287b4631102fc291dead5 columnFamilyName colfamily21 2023-07-11 20:39:47,149 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] regionserver.HStore(310): Store=1f1f55e7b9bb4f716044688e8cde5170/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,150 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] regionserver.HStore(310): Store=9996238a94686c4a78ed12dd9da6fbe6/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,150 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,150 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34c7c2230412431453d1e48ace10e600, ASSIGN in 1.0400 sec 2023-07-11 20:39:47,150 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(310): Store=ec622bf0b15287b4631102fc291dead5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,151 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,152 DEBUG [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily21 2023-07-11 20:39:47,153 DEBUG [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily21 2023-07-11 20:39:47,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=271710c1c9bb963a3440ef4a722e1452, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:47,154 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987153"}]},"ts":"1689107987153"} 2023-07-11 20:39:47,154 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9996238a94686c4a78ed12dd9da6fbe6 columnFamilyName colfamily21 2023-07-11 20:39:47,154 DEBUG [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily21 2023-07-11 20:39:47,154 DEBUG [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily21 2023-07-11 20:39:47,155 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f1f55e7b9bb4f716044688e8cde5170 columnFamilyName colfamily21 2023-07-11 20:39:47,155 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] regionserver.HStore(310): Store=9996238a94686c4a78ed12dd9da6fbe6/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,156 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] regionserver.HStore(310): Store=1f1f55e7b9bb4f716044688e8cde5170/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,156 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily31 2023-07-11 20:39:47,156 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,156 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,156 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily31 2023-07-11 20:39:47,157 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec622bf0b15287b4631102fc291dead5 columnFamilyName colfamily31 2023-07-11 20:39:47,158 DEBUG [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily31 2023-07-11 20:39:47,158 DEBUG [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily31 2023-07-11 20:39:47,159 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(310): Store=ec622bf0b15287b4631102fc291dead5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,159 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9996238a94686c4a78ed12dd9da6fbe6 columnFamilyName colfamily31 2023-07-11 20:39:47,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,161 INFO [StoreOpener-9996238a94686c4a78ed12dd9da6fbe6-1] regionserver.HStore(310): Store=9996238a94686c4a78ed12dd9da6fbe6/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,161 DEBUG [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily31 2023-07-11 20:39:47,161 DEBUG [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily31 2023-07-11 20:39:47,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=17 2023-07-11 20:39:47,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=17, state=SUCCESS; OpenRegionProcedure 271710c1c9bb963a3440ef4a722e1452, server=jenkins-hbase5.apache.org,42009,1689107981238 in 684 msec 2023-07-11 20:39:47,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,163 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f1f55e7b9bb4f716044688e8cde5170 columnFamilyName colfamily31 2023-07-11 20:39:47,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,164 INFO [StoreOpener-1f1f55e7b9bb4f716044688e8cde5170-1] regionserver.HStore(310): Store=1f1f55e7b9bb4f716044688e8cde5170/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=271710c1c9bb963a3440ef4a722e1452, ASSIGN in 1.0570 sec 2023-07-11 20:39:47,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ec622bf0b15287b4631102fc291dead5 2023-07-11 20:39:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:39:47,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:39:47,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ec622bf0b15287b4631102fc291dead5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73881368, jitterRate=0.10091817378997803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ec622bf0b15287b4631102fc291dead5: 2023-07-11 20:39:47,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5., pid=39, masterSystemTime=1689107986451 2023-07-11 20:39:47,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 9996238a94686c4a78ed12dd9da6fbe6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70177902, jitterRate=0.04573222994804382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 9996238a94686c4a78ed12dd9da6fbe6: 2023-07-11 20:39:47,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:39:47,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6., pid=46, masterSystemTime=1689107986565 2023-07-11 20:39:47,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:39:47,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:39:47,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1f1f55e7b9bb4f716044688e8cde5170; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61360413, jitterRate=-0.08565859496593475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1f1f55e7b9bb4f716044688e8cde5170: 2023-07-11 20:39:47,196 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:47,196 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987196"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987196"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987196"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987196"}]},"ts":"1689107987196"} 2023-07-11 20:39:47,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:39:47,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170., pid=60, masterSystemTime=1689107986677 2023-07-11 20:39:47,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:39:47,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:39:47,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb68c30b67501f47ae63c14ce057756a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-11 20:39:47,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:39:47,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:39:47,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:39:47,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe2b95730f173e86f1c38a731479321f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2023-07-11 20:39:47,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=29 2023-07-11 20:39:47,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=29, state=SUCCESS; OpenRegionProcedure ec622bf0b15287b4631102fc291dead5, server=jenkins-hbase5.apache.org,44935,1689107981188 in 879 msec 2023-07-11 20:39:47,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN in 1.0980 sec 2023-07-11 20:39:47,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:47,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987209"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987209"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987209"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987209"}]},"ts":"1689107987209"} 2023-07-11 20:39:47,218 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=13 2023-07-11 20:39:47,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=13, state=SUCCESS; OpenRegionProcedure 1f1f55e7b9bb4f716044688e8cde5170, server=jenkins-hbase5.apache.org,41489,1689107981112 in 606 msec 2023-07-11 20:39:47,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1f1f55e7b9bb4f716044688e8cde5170, ASSIGN in 1.1160 sec 2023-07-11 20:39:47,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:47,225 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987224"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987224"}]},"ts":"1689107987224"} 2023-07-11 20:39:47,227 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,235 DEBUG [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily11 2023-07-11 20:39:47,235 DEBUG [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily11 2023-07-11 20:39:47,235 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb68c30b67501f47ae63c14ce057756a columnFamilyName colfamily11 2023-07-11 20:39:47,237 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] regionserver.HStore(310): Store=bb68c30b67501f47ae63c14ce057756a/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,237 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,242 DEBUG [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily21 2023-07-11 20:39:47,242 DEBUG [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily21 2023-07-11 20:39:47,242 DEBUG [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily11 2023-07-11 20:39:47,242 DEBUG [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily11 2023-07-11 20:39:47,242 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb68c30b67501f47ae63c14ce057756a columnFamilyName colfamily21 2023-07-11 20:39:47,243 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe2b95730f173e86f1c38a731479321f columnFamilyName colfamily11 2023-07-11 20:39:47,243 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] regionserver.HStore(310): Store=bb68c30b67501f47ae63c14ce057756a/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,244 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,244 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] regionserver.HStore(310): Store=fe2b95730f173e86f1c38a731479321f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,244 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=26 2023-07-11 20:39:47,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=26, state=SUCCESS; OpenRegionProcedure 9996238a94686c4a78ed12dd9da6fbe6, server=jenkins-hbase5.apache.org,42009,1689107981238 in 810 msec 2023-07-11 20:39:47,247 DEBUG [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily31 2023-07-11 20:39:47,247 DEBUG [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily21 2023-07-11 20:39:47,247 DEBUG [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily21 2023-07-11 20:39:47,247 DEBUG [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily31 2023-07-11 20:39:47,248 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe2b95730f173e86f1c38a731479321f columnFamilyName colfamily21 2023-07-11 20:39:47,248 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb68c30b67501f47ae63c14ce057756a columnFamilyName colfamily31 2023-07-11 20:39:47,249 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] regionserver.HStore(310): Store=fe2b95730f173e86f1c38a731479321f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,249 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,249 INFO [StoreOpener-bb68c30b67501f47ae63c14ce057756a-1] regionserver.HStore(310): Store=bb68c30b67501f47ae63c14ce057756a/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,252 DEBUG [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily31 2023-07-11 20:39:47,252 DEBUG [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily31 2023-07-11 20:39:47,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9996238a94686c4a78ed12dd9da6fbe6, ASSIGN in 1.1410 sec 2023-07-11 20:39:47,253 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe2b95730f173e86f1c38a731479321f columnFamilyName colfamily31 2023-07-11 20:39:47,253 INFO [StoreOpener-fe2b95730f173e86f1c38a731479321f-1] regionserver.HStore(310): Store=fe2b95730f173e86f1c38a731479321f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:39:47,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for fe2b95730f173e86f1c38a731479321f 2023-07-11 20:39:47,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened bb68c30b67501f47ae63c14ce057756a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73237293, jitterRate=0.0913207083940506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened fe2b95730f173e86f1c38a731479321f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74160977, jitterRate=0.10508467257022858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for bb68c30b67501f47ae63c14ce057756a: 2023-07-11 20:39:47,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for fe2b95730f173e86f1c38a731479321f: 2023-07-11 20:39:47,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a., pid=47, masterSystemTime=1689107986565 2023-07-11 20:39:47,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f., pid=56, masterSystemTime=1689107986677 2023-07-11 20:39:47,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:39:47,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:39:47,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:39:47,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a66eca7e7de9f874fbf8a3b37791f8be, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-11 20:39:47,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=bb68c30b67501f47ae63c14ce057756a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:47,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987280"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987280"}]},"ts":"1689107987280"} 2023-07-11 20:39:47,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:39:47,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:39:47,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:39:47,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e8a887c1dfba3387c203eaa29970d81, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81.', STARTKEY => 'vvv', ENDKEY => 'www'} 2023-07-11 20:39:47,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=32 2023-07-11 20:39:47,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=32, state=SUCCESS; OpenRegionProcedure bb68c30b67501f47ae63c14ce057756a, server=jenkins-hbase5.apache.org,42009,1689107981238 in 855 msec 2023-07-11 20:39:47,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb68c30b67501f47ae63c14ce057756a, ASSIGN in 1.1800 sec 2023-07-11 20:39:47,290 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=fe2b95730f173e86f1c38a731479321f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:47,290 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987290"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987290"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987290"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987290"}]},"ts":"1689107987290"} 2023-07-11 20:39:47,292 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,294 DEBUG [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily11 2023-07-11 20:39:47,294 DEBUG [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily11 2023-07-11 20:39:47,295 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a66eca7e7de9f874fbf8a3b37791f8be columnFamilyName colfamily11 2023-07-11 20:39:47,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=21 2023-07-11 20:39:47,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=21, state=SUCCESS; OpenRegionProcedure fe2b95730f173e86f1c38a731479321f, server=jenkins-hbase5.apache.org,41489,1689107981112 in 751 msec 2023-07-11 20:39:47,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fe2b95730f173e86f1c38a731479321f, ASSIGN in 1.1920 sec 2023-07-11 20:39:47,305 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] regionserver.HStore(310): Store=a66eca7e7de9f874fbf8a3b37791f8be/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,305 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,305 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,307 DEBUG [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily21 2023-07-11 20:39:47,307 DEBUG [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily21 2023-07-11 20:39:47,308 DEBUG [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily11 2023-07-11 20:39:47,308 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a66eca7e7de9f874fbf8a3b37791f8be columnFamilyName colfamily21 2023-07-11 20:39:47,308 DEBUG [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily11 2023-07-11 20:39:47,309 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] regionserver.HStore(310): Store=a66eca7e7de9f874fbf8a3b37791f8be/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,309 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,309 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e8a887c1dfba3387c203eaa29970d81 columnFamilyName colfamily11 2023-07-11 20:39:47,311 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] regionserver.HStore(310): Store=8e8a887c1dfba3387c203eaa29970d81/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,311 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,311 DEBUG [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily31 2023-07-11 20:39:47,311 DEBUG [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily31 2023-07-11 20:39:47,312 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a66eca7e7de9f874fbf8a3b37791f8be columnFamilyName colfamily31 2023-07-11 20:39:47,312 INFO [StoreOpener-a66eca7e7de9f874fbf8a3b37791f8be-1] regionserver.HStore(310): Store=a66eca7e7de9f874fbf8a3b37791f8be/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,313 DEBUG [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily21 2023-07-11 20:39:47,313 DEBUG [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily21 2023-07-11 20:39:47,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,314 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e8a887c1dfba3387c203eaa29970d81 columnFamilyName colfamily21 2023-07-11 20:39:47,317 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] regionserver.HStore(310): Store=8e8a887c1dfba3387c203eaa29970d81/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,317 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:39:47,321 DEBUG [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily31 2023-07-11 20:39:47,321 DEBUG [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily31 2023-07-11 20:39:47,322 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e8a887c1dfba3387c203eaa29970d81 columnFamilyName colfamily31 2023-07-11 20:39:47,328 INFO [StoreOpener-8e8a887c1dfba3387c203eaa29970d81-1] regionserver.HStore(310): Store=8e8a887c1dfba3387c203eaa29970d81/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened a66eca7e7de9f874fbf8a3b37791f8be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65273856, jitterRate=-0.02734375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for a66eca7e7de9f874fbf8a3b37791f8be: 2023-07-11 20:39:47,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be., pid=50, masterSystemTime=1689107986565 2023-07-11 20:39:47,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:39:47,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:39:47,343 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:47,343 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987343"}]},"ts":"1689107987343"} 2023-07-11 20:39:47,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:39:47,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=19 2023-07-11 20:39:47,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=19, state=SUCCESS; OpenRegionProcedure a66eca7e7de9f874fbf8a3b37791f8be, server=jenkins-hbase5.apache.org,42009,1689107981238 in 888 msec 2023-07-11 20:39:47,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a66eca7e7de9f874fbf8a3b37791f8be, ASSIGN in 1.2470 sec 2023-07-11 20:39:47,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 8e8a887c1dfba3387c203eaa29970d81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71056119, jitterRate=0.05881868302822113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 8e8a887c1dfba3387c203eaa29970d81: 2023-07-11 20:39:47,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81., pid=59, masterSystemTime=1689107986677 2023-07-11 20:39:47,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:39:47,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:39:47,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:39:47,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3f1f11bb87dbde31c4a80a24b4804cf, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf.', STARTKEY => 'yyy', ENDKEY => 'zzz'} 2023-07-11 20:39:47,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:39:47,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,371 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=8e8a887c1dfba3387c203eaa29970d81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:47,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987371"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987371"}]},"ts":"1689107987371"} 2023-07-11 20:39:47,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=31 2023-07-11 20:39:47,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=31, state=SUCCESS; OpenRegionProcedure 8e8a887c1dfba3387c203eaa29970d81, server=jenkins-hbase5.apache.org,41489,1689107981112 in 780 msec 2023-07-11 20:39:47,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8e8a887c1dfba3387c203eaa29970d81, ASSIGN in 1.2710 sec 2023-07-11 20:39:47,383 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,388 DEBUG [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily11 2023-07-11 20:39:47,388 DEBUG [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily11 2023-07-11 20:39:47,388 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f1f11bb87dbde31c4a80a24b4804cf columnFamilyName colfamily11 2023-07-11 20:39:47,389 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] regionserver.HStore(310): Store=c3f1f11bb87dbde31c4a80a24b4804cf/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,389 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,391 DEBUG [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily21 2023-07-11 20:39:47,391 DEBUG [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily21 2023-07-11 20:39:47,392 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f1f11bb87dbde31c4a80a24b4804cf columnFamilyName colfamily21 2023-07-11 20:39:47,392 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] regionserver.HStore(310): Store=c3f1f11bb87dbde31c4a80a24b4804cf/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,392 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,394 DEBUG [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily31 2023-07-11 20:39:47,394 DEBUG [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily31 2023-07-11 20:39:47,395 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f1f11bb87dbde31c4a80a24b4804cf columnFamilyName colfamily31 2023-07-11 20:39:47,395 INFO [StoreOpener-c3f1f11bb87dbde31c4a80a24b4804cf-1] regionserver.HStore(310): Store=c3f1f11bb87dbde31c4a80a24b4804cf/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:39:47,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:39:47,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:39:47,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:39:47,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c3f1f11bb87dbde31c4a80a24b4804cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72614944, jitterRate=0.0820469856262207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:39:47,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c3f1f11bb87dbde31c4a80a24b4804cf: 2023-07-11 20:39:47,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf., pid=57, masterSystemTime=1689107986677 2023-07-11 20:39:47,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:39:47,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:39:47,415 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:47,416 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689107987415"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689107987415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689107987415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689107987415"}]},"ts":"1689107987415"} 2023-07-11 20:39:47,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=34 2023-07-11 20:39:47,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=34, state=SUCCESS; OpenRegionProcedure c3f1f11bb87dbde31c4a80a24b4804cf, server=jenkins-hbase5.apache.org,41489,1689107981112 in 867 msec 2023-07-11 20:39:47,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=34, resume processing ppid=9 2023-07-11 20:39:47,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c3f1f11bb87dbde31c4a80a24b4804cf, ASSIGN in 1.3130 sec 2023-07-11 20:39:47,423 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:39:47,424 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689107987423"}]},"ts":"1689107987423"} 2023-07-11 20:39:47,425 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLED in hbase:meta 2023-07-11 20:39:47,429 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:39:47,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true in 2.4670 sec 2023-07-11 20:39:49,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:39:49,192 INFO [Listener at localhost/45761] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, procId: 9 completed 2023-07-11 20:39:49,192 DEBUG [Listener at localhost/45761] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true get assigned. Timeout = 60000ms 2023-07-11 20:39:49,194 INFO [Listener at localhost/45761] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:39:49,199 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44935] regionserver.StoreScanner(1093): Switch to stream read (scanned=32940 bytes) of info 2023-07-11 20:39:49,213 INFO [Listener at localhost/45761] hbase.HBaseTestingUtility(3484): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned to meta. Checking AM states. 2023-07-11 20:39:49,214 INFO [Listener at localhost/45761] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:39:49,214 INFO [Listener at localhost/45761] hbase.HBaseTestingUtility(3504): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned. 2023-07-11 20:39:49,238 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 20:39:49,340 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true' 2023-07-11 20:39:49,343 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 20:39:49,344 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 20:39:49,443 DEBUG [hconnection-0x13b46851-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:39:49,453 DEBUG [hconnection-0x13b46851-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:39:49,485 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44935] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//172.31.10.131 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:39:49,502 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:39:49,510 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:39:49,517 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41489] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5624 Client: jenkins//172.31.10.131 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:39:49,536 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42009] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5625 Client: jenkins//172.31.10.131 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:39:49,777 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 20:39:49,792 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 20:39:49,803 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 20:39:49,812 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 20:39:49,821 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 20:39:49,828 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 20:39:49,835 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 20:39:49,840 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 20:39:49,847 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 20:39:49,852 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 20:39:49,858 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 20:39:49,863 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 20:39:49,868 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 20:39:49,873 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 20:39:49,878 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 20:39:49,882 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 20:39:49,886 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 20:39:49,889 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 20:39:49,894 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 20:39:49,898 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 20:39:49,902 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 20:39:49,907 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 20:39:49,911 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 20:39:49,915 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 20:39:49,919 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 20:39:49,926 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 20:39:49,929 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 20:39:49,931 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 20:39:49,934 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 20:39:49,937 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 20:39:49,939 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 20:39:49,942 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 20:39:49,946 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 20:39:49,949 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 20:39:49,952 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 20:39:49,952 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 20:39:49,955 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 20:39:49,962 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 20:39:49,965 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 20:39:49,969 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 20:39:49,972 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 20:39:49,974 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 20:39:49,977 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 20:39:49,981 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 20:39:49,984 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 20:39:49,986 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 20:39:49,989 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 20:39:49,991 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 20:39:49,994 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 20:39:49,996 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 20:39:49,998 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 20:39:50,001 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 20:39:50,272 WARN [Listener at localhost/45761] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: true 2023-07-11 20:39:50,273 INFO [Listener at localhost/45761] assignment.AssignmentTestingUtil(82): KILL REGION SERVER jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:50,273 INFO [Listener at localhost/45761] hbase.MiniHBaseCluster(271): Killing jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:50,277 ERROR [Listener at localhost/45761] helpers.MarkerIgnoringBase(143): ***** ABORTING region server jenkins-hbase5.apache.org,44935,1689107981188: Simulated kill ***** 2023-07-11 20:39:50,279 ERROR [Listener at localhost/45761] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-11 20:39:50,282 DEBUG [Listener at localhost/45761] util.JSONBean(130): Listing beans for java.lang:type=Memory 2023-07-11 20:39:50,284 DEBUG [Listener at localhost/45761] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=IPC 2023-07-11 20:39:50,288 DEBUG [Listener at localhost/45761] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Replication 2023-07-11 20:39:50,290 DEBUG [Listener at localhost/45761] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Server 2023-07-11 20:39:50,298 INFO [Listener at localhost/45761] regionserver.HRegionServer(2557): Dump of metrics as JSON on abort: { "beans": [ { "name": "java.lang:type=Memory", "modelerType": "sun.management.MemoryImpl", "Verbose": false, "ObjectPendingFinalizationCount": 0, "HeapMemoryUsage": { "committed": 977272832, "init": 513802240, "max": 2051014656, "used": 457990792 }, "NonHeapMemoryUsage": { "committed": 129196032, "init": 2555904, "max": -1, "used": 126984144 }, "ObjectName": "java.lang:type=Memory" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType": "RegionServer,sub=IPC", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase5.apache.org", "queueSize": 0, "numCallsInGeneralQueue": 0, "numCallsInReplicationQueue": 0, "numCallsInPriorityQueue": 0, "numCallsInMetaPriorityQueue": 0, "numOpenConnections": 1, "numActiveHandler": 0, "numActiveGeneralHandler": 0, "numActivePriorityHandler": 0, "numActiveReplicationHandler": 0, "numGeneralCallsDropped": 0, "numLifoModeSwitches": 0, "numCallsInWriteQueue": 0, "numCallsInReadQueue": 0, "numCallsInScanQueue": 0, "numActiveWriteHandler": 0, "numActiveReadHandler": 0, "numActiveScanHandler": 0, "nettyDirectMemoryUsage": 67108864, "receivedBytes": 55234, "exceptions.RegionMovedException": 0, "authenticationSuccesses": 0, "authorizationFailures": 0, "exceptions.requestTooBig": 0, "exceptions.OutOfOrderScannerNextException": 0, "exceptions.rpcThrottling": 0, "exceptions.otherExceptions": 0, "ProcessCallTime_num_ops": 133, "ProcessCallTime_min": 0, "ProcessCallTime_max": 24, "ProcessCallTime_mean": 2, "ProcessCallTime_25th_percentile": 6, "ProcessCallTime_median": 12, "ProcessCallTime_75th_percentile": 18, "ProcessCallTime_90th_percentile": 21, "ProcessCallTime_95th_percentile": 22, "ProcessCallTime_98th_percentile": 23, "ProcessCallTime_99th_percentile": 23, "ProcessCallTime_99.9th_percentile": 23, "ProcessCallTime_TimeRangeCount_0-1": 133, "exceptions.callQueueTooBig": 0, "QueueCallTime_num_ops": 133, "QueueCallTime_min": 0, "QueueCallTime_max": 1, "QueueCallTime_mean": 0, "QueueCallTime_25th_percentile": 0, "QueueCallTime_median": 0, "QueueCallTime_75th_percentile": 0, "QueueCallTime_90th_percentile": 0, "QueueCallTime_95th_percentile": 0, "QueueCallTime_98th_percentile": 0, "QueueCallTime_99th_percentile": 0, "QueueCallTime_99.9th_percentile": 0, "QueueCallTime_TimeRangeCount_0-1": 133, "authenticationFailures": 0, "exceptions.multiResponseTooLarge": 0, "TotalCallTime_num_ops": 133, "TotalCallTime_min": 0, "TotalCallTime_max": 24, "TotalCallTime_mean": 2, "TotalCallTime_25th_percentile": 6, "TotalCallTime_median": 12, "TotalCallTime_75th_percentile": 18, "TotalCallTime_90th_percentile": 21, "TotalCallTime_95th_percentile": 22, "TotalCallTime_98th_percentile": 23, "TotalCallTime_99th_percentile": 23, "TotalCallTime_99.9th_percentile": 23, "TotalCallTime_TimeRangeCount_0-1": 133, "exceptions.RegionTooBusyException": 0, "exceptions.FailedSanityCheckException": 0, "ResponseSize_num_ops": 133, "ResponseSize_min": 0, "ResponseSize_max": 20691, "ResponseSize_mean": 373, "ResponseSize_25th_percentile": 5172, "ResponseSize_median": 10345, "ResponseSize_75th_percentile": 15518, "ResponseSize_90th_percentile": 18621, "ResponseSize_95th_percentile": 19656, "ResponseSize_98th_percentile": 20277, "ResponseSize_99th_percentile": 20484, "ResponseSize_99.9th_percentile": 20670, "ResponseSize_SizeRangeCount_0-10": 133, "exceptions.UnknownScannerException": 0, "exceptions": 0, "authenticationFallbacks": 0, "exceptions.quotaExceeded": 0, "exceptions.NotServingRegionException": 0, "authorizationSuccesses": 0, "exceptions.ScannerResetException": 0, "RequestSize_num_ops": 133, "RequestSize_min": 39, "RequestSize_max": 14905, "RequestSize_mean": 396, "RequestSize_25th_percentile": 3755, "RequestSize_median": 7472, "RequestSize_75th_percentile": 11188, "RequestSize_90th_percentile": 13418, "RequestSize_95th_percentile": 14161, "RequestSize_98th_percentile": 14607, "RequestSize_99th_percentile": 14756, "RequestSize_99.9th_percentile": 14890, "RequestSize_SizeRangeCount_0-10": 133, "sentBytes": 50884 } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType": "RegionServer,sub=Replication", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase5.apache.org", "source.shippedHFiles": 0, "Source.ageOfLastShippedOp_num_ops": 0, "Source.ageOfLastShippedOp_min": 0, "Source.ageOfLastShippedOp_max": 0, "Source.ageOfLastShippedOp_mean": 0, "Source.ageOfLastShippedOp_25th_percentile": 0, "Source.ageOfLastShippedOp_median": 0, "Source.ageOfLastShippedOp_75th_percentile": 0, "Source.ageOfLastShippedOp_90th_percentile": 0, "Source.ageOfLastShippedOp_95th_percentile": 0, "Source.ageOfLastShippedOp_98th_percentile": 0, "Source.ageOfLastShippedOp_99th_percentile": 0, "Source.ageOfLastShippedOp_99.9th_percentile": 0, "source.uncleanlyClosedLogs": 0, "source.closedLogsWithUnknownFileLength": 0, "source.walReaderEditsBufferUsage": 0, "source.repeatedLogFileBytes": 0, "source.shippedKBs": 0, "source.sizeOfHFileRefsQueue": 0, "source.logReadInBytes": 0, "source.completedRecoverQueues": 0, "source.sizeOfLogQueue": 0, "source.restartedLogReading": 0, "source.failedRecoverQueues": 0, "source.ignoredUncleanlyClosedLogContentsInBytes": 0, "Sink.ageOfLastAppliedOp_num_ops": 0, "Sink.ageOfLastAppliedOp_min": 0, "Sink.ageOfLastAppliedOp_max": 0, "Sink.ageOfLastAppliedOp_mean": 0, "Sink.ageOfLastAppliedOp_25th_percentile": 0, "Sink.ageOfLastAppliedOp_median": 0, "Sink.ageOfLastAppliedOp_75th_percentile": 0, "Sink.ageOfLastAppliedOp_90th_percentile": 0, "Sink.ageOfLastAppliedOp_95th_percentile": 0, "Sink.ageOfLastAppliedOp_98th_percentile": 0, "Sink.ageOfLastAppliedOp_99th_percentile": 0, "Sink.ageOfLastAppliedOp_99.9th_percentile": 0, "source.logEditsRead": 0, "source.numInitializing": 0, "source.shippedOps": 0, "sink.appliedHFiles": 0, "source.logEditsFiltered": 0, "source.shippedBytes": 0, "sink.appliedOps": 0, "source.completedLogs": 0, "source.failedBatches": 0, "sink.failedBatches": 0, "source.shippedBatches": 0, "sink.appliedBatches": 0 } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType": "RegionServer,sub=Server", "tag.zookeeperQuorum": "127.0.0.1:57657", "tag.serverName": "jenkins-hbase5.apache.org,41489,1689107981112", "tag.clusterId": "cc560617-abeb-4bcc-bc75-a7d0fbe7f993", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase5.apache.org", "regionCount": 8, "storeCount": 24, "hlogFileCount": 1, "hlogFileSize": 0, "storeFileCount": 0, "maxStoreFileCount": 0, "memStoreSize": 0, "storeFileSize": 0, "maxStoreFileAge": 0, "minStoreFileAge": 0, "avgStoreFileAge": 0, "numReferenceFiles": 0, "regionServerStartTime": 1689107981112, "averageRegionSize": 0, "storeFileIndexSize": 0, "staticIndexSize": 0, "staticBloomSize": 0, "mutationsWithoutWALCount": 0, "mutationsWithoutWALSize": 0, "percentFilesLocal": 0.0, "percentFilesLocalSecondaryRegions": 0.0, "totalBytesRead": 0, "localBytesRead": 0, "shortCircuitBytesRead": 0, "zeroCopyBytesRead": 0, "splitQueueLength": 0, "compactionQueueLength": 0, "smallCompactionQueueLength": 0, "largeCompactionQueueLength": 0, "flushQueueLength": 0, "blockCacheFreeSize": 819803968, "blockCacheCount": 0, "blockCacheDataBlockCount": 0, "blockCacheSize": 601920, "blockCacheCountHitPercent": 0.0, "blockCacheExpressHitPercent": 0.0, "l1CacheSize": 601920, "l1CacheFreeSize": 819803968, "l1CacheCount": 0, "l1CacheEvictionCount": 0, "l1CacheHitCount": 0, "l1CacheMissCount": 0, "l1CacheHitRatio": 0.0, "l1CacheMissRatio": 0.0, "l2CacheSize": 0, "l2CacheFreeSize": 0, "l2CacheCount": 0, "l2CacheEvictionCount": 0, "l2CacheHitCount": 0, "l2CacheMissCount": 0, "l2CacheHitRatio": 0.0, "l2CacheMissRatio": 0.0, "mobFileCacheCount": 0, "mobFileCacheHitPercent": 0.0, "readRequestRatePerSecond": 0.0, "writeRequestRatePerSecond": 0.0, "ByteBuffAllocatorHeapAllocationBytes": 0, "ByteBuffAllocatorPoolAllocationBytes": 0, "ByteBuffAllocatorHeapAllocationRatio": 0.0, "ByteBuffAllocatorTotalBufferCount": 186, "ByteBuffAllocatorUsedBufferCount": 0, "totalRequestCount": 0, "totalRowActionRequestCount": 0, "readRequestCount": 0, "filteredReadRequestCount": 0, "writeRequestCount": 0, "rpcGetRequestCount": 0, "rpcFullScanRequestCount": 0, "rpcScanRequestCount": 0, "rpcMultiRequestCount": 0, "rpcMutateRequestCount": 0, "checkMutateFailedCount": 0, "checkMutatePassedCount": 0, "blockCacheHitCount": 0, "blockCacheHitCountPrimary": 0, "blockCacheHitCachingCount": 0, "blockCacheMissCount": 0, "blockCacheMissCountPrimary": 0, "blockCacheMissCachingCount": 0, "blockCacheEvictionCount": 0, "blockCacheEvictionCountPrimary": 0, "blockCacheFailedInsertionCount": 0, "blockCacheDataMissCount": 0, "blockCacheLeafIndexMissCount": 0, "blockCacheBloomChunkMissCount": 0, "blockCacheMetaMissCount": 0, "blockCacheRootIndexMissCount": 0, "blockCacheIntermediateIndexMissCount": 0, "blockCacheFileInfoMissCount": 0, "blockCacheGeneralBloomMetaMissCount": 0, "blockCacheDeleteFamilyBloomMissCount": 0, "blockCacheTrailerMissCount": 0, "blockCacheDataHitCount": 0, "blockCacheLeafIndexHitCount": 0, "blockCacheBloomChunkHitCount": 0, "blockCacheMetaHitCount": 0, "blockCacheRootIndexHitCount": 0, "blockCacheIntermediateIndexHitCount": 0, "blockCacheFileInfoHitCount": 0, "blockCacheGeneralBloomMetaHitCount": 0, "blockCacheDeleteFamilyBloomHitCount": 0, "blockCacheTrailerHitCount": 0, "updatesBlockedTime": 0, "flushedCellsCount": 0, "compactedCellsCount": 0, "majorCompactedCellsCount": 0, "flushedCellsSize": 0, "compactedCellsSize": 0, "majorCompactedCellsSize": 0, "cellsCountCompactedFromMob": 0, "cellsCountCompactedToMob": 0, "cellsSizeCompactedFromMob": 0, "cellsSizeCompactedToMob": 0, "mobFlushCount": 0, "mobFlushedCellsCount": 0, "mobFlushedCellsSize": 0, "mobScanCellsCount": 0, "mobScanCellsSize": 0, "mobFileCacheAccessCount": 0, "mobFileCacheMissCount": 0, "mobFileCacheEvictedCount": 0, "hedgedReads": 0, "hedgedReadWins": 0, "hedgedReadOpsInCurThread": 0, "blockedRequestCount": 0, "CheckAndMutate_num_ops": 0, "CheckAndMutate_min": 0, "CheckAndMutate_max": 0, "CheckAndMutate_mean": 0, "CheckAndMutate_25th_percentile": 0, "CheckAndMutate_median": 0, "CheckAndMutate_75th_percentile": 0, "CheckAndMutate_90th_percentile": 0, "CheckAndMutate_95th_percentile": 0, "CheckAndMutate_98th_percentile": 0, "CheckAndMutate_99th_percentile": 0, "CheckAndMutate_99.9th_percentile": 0, "MajorCompactionTime_num_ops": 0, "MajorCompactionTime_min": 0, "MajorCompactionTime_max": 0, "MajorCompactionTime_mean": 0, "MajorCompactionTime_25th_percentile": 0, "MajorCompactionTime_median": 0, "MajorCompactionTime_75th_percentile": 0, "MajorCompactionTime_90th_percentile": 0, "MajorCompactionTime_95th_percentile": 0, "MajorCompactionTime_98th_percentile": 0, "MajorCompactionTime_99th_percentile": 0, "MajorCompactionTime_99.9th_percentile": 0, "PauseTimeWithGc_num_ops": 0, "PauseTimeWithGc_min": 0, "PauseTimeWithGc_max": 0, "PauseTimeWithGc_mean": 0, "PauseTimeWithGc_25th_percentile": 0, "PauseTimeWithGc_median": 0, "PauseTimeWithGc_75th_percentile": 0, "PauseTimeWithGc_90th_percentile": 0, "PauseTimeWithGc_95th_percentile": 0, "PauseTimeWithGc_98th_percentile": 0, "PauseTimeWithGc_99th_percentile": 0, "PauseTimeWithGc_99.9th_percentile": 0, "compactedOutputBytes": 0, "pauseWarnThresholdExceeded": 0, "ScanTime_num_ops": 0, "ScanTime_min": 0, "ScanTime_max": 0, "ScanTime_mean": 0, "ScanTime_25th_percentile": 0, "ScanTime_median": 0, "ScanTime_75th_percentile": 0, "ScanTime_90th_percentile": 0, "ScanTime_95th_percentile": 0, "ScanTime_98th_percentile": 0, "ScanTime_99th_percentile": 0, "ScanTime_99.9th_percentile": 0, "Increment_num_ops": 0, "Increment_min": 0, "Increment_max": 0, "Increment_mean": 0, "Increment_25th_percentile": 0, "Increment_median": 0, "Increment_75th_percentile": 0, "Increment_90th_percentile": 0, "Increment_95th_percentile": 0, "Increment_98th_percentile": 0, "Increment_99th_percentile": 0, "Increment_99.9th_percentile": 0, "Delete_num_ops": 0, "Delete_min": 0, "Delete_max": 0, "Delete_mean": 0, "Delete_25th_percentile": 0, "Delete_median": 0, "Delete_75th_percentile": 0, "Delete_90th_percentile": 0, "Delete_95th_percentile": 0, "Delete_98th_percentile": 0, "Delete_99th_percentile": 0, "Delete_99.9th_percentile": 0, "Put_num_ops": 0, "Put_min": 0, "Put_max": 0, "Put_mean": 0, "Put_25th_percentile": 0, "Put_median": 0, "Put_75th_percentile": 0, "Put_90th_percentile": 0, "Put_95th_percentile": 0, "Put_98th_percentile": 0, "Put_99th_percentile": 0, "Put_99.9th_percentile": 0, "DeleteBatch_num_ops": 0, "DeleteBatch_min": 0, "DeleteBatch_max": 0, "DeleteBatch_mean": 0, "DeleteBatch_25th_percentile": 0, "DeleteBatch_median": 0, "DeleteBatch_75th_percentile": 0, "DeleteBatch_90th_percentile": 0, "DeleteBatch_95th_percentile": 0, "DeleteBatch_98th_percentile": 0, "DeleteBatch_99th_percentile": 0, "DeleteBatch_99.9th_percentile": 0, "splitRequestCount": 0, "FlushMemstoreSize_num_ops": 0, "FlushMemstoreSize_min": 0, "FlushMemstoreSize_max": 0, "FlushMemstoreSize_mean": 0, "FlushMemstoreSize_25th_percentile": 0, "FlushMemstoreSize_median": 0, "FlushMemstoreSize_75th_percentile": 0, "FlushMemstoreSize_90th_percentile": 0, "FlushMemstoreSize_95th_percentile": 0, "FlushMemstoreSize_98th_percentile": 0, "FlushMemstoreSize_99th_percentile": 0, "FlushMemstoreSize_99.9th_percentile": 0, "CompactionInputFileCount_num_ops": 0, "CompactionInputFileCount_min": 0, "CompactionInputFileCount_max": 0, "CompactionInputFileCount_mean": 0, "CompactionInputFileCount_25th_percentile": 0, "CompactionInputFileCount_median": 0, "CompactionInputFileCount_75th_percentile": 0, "CompactionInputFileCount_90th_percentile": 0, "CompactionInputFileCount_95th_percentile": 0, "CompactionInputFileCount_98th_percentile": 0, "CompactionInputFileCount_99th_percentile": 0, "CompactionInputFileCount_99.9th_percentile": 0, "PutBatch_num_ops": 0, "PutBatch_min": 0, "PutBatch_max": 0, "PutBatch_mean": 0, "PutBatch_25th_percentile": 0, "PutBatch_median": 0, "PutBatch_75th_percentile": 0, "PutBatch_90th_percentile": 0, "PutBatch_95th_percentile": 0, "PutBatch_98th_percentile": 0, "PutBatch_99th_percentile": 0, "PutBatch_99.9th_percentile": 0, "CompactionTime_num_ops": 0, "CompactionTime_min": 0, "CompactionTime_max": 0, "CompactionTime_mean": 0, "CompactionTime_25th_percentile": 0, "CompactionTime_median": 0, "CompactionTime_75th_percentile": 0, "CompactionTime_90th_percentile": 0, "CompactionTime_95th_percentile": 0, "CompactionTime_98th_percentile": 0, "CompactionTime_99th_percentile": 0, "CompactionTime_99.9th_percentile": 0, "Get_num_ops": 0, "Get_min": 0, "Get_max": 0, "Get_mean": 0, "Get_25th_percentile": 0, "Get_median": 0, "Get_75th_percentile": 0, "Get_90th_percentile": 0, "Get_95th_percentile": 0, "Get_98th_percentile": 0, "Get_99th_percentile": 0, "Get_99.9th_percentile": 0, "MajorCompactionInputFileCount_num_ops": 0, "MajorCompactionInputFileCount_min": 0, "MajorCompactionInputFileCount_max": 0, "MajorCompactionInputFileCount_mean": 0, "MajorCompactionInputFileCount_25th_percentile": 0, "MajorCompactionInputFileCount_median": 0, "MajorCompactionInputFileCount_75th_percentile": 0, "MajorCompactionInputFileCount_90th_percentile": 0, "MajorCompactionInputFileCount_95th_percentile": 0, "MajorCompactionInputFileCount_98th_percentile": 0, "MajorCompactionInputFileCount_99th_percentile": 0, "MajorCompactionInputFileCount_99.9th_percentile": 0, "CheckAndPut_num_ops": 0, "CheckAndPut_min": 0, "CheckAndPut_max": 0, "CheckAndPut_mean": 0, "CheckAndPut_25th_percentile": 0, "CheckAndPut_median": 0, "CheckAndPut_75th_percentile": 0, "CheckAndPut_90th_percentile": 0, "CheckAndPut_95th_percentile": 0, "CheckAndPut_98th_percentile": 0, "CheckAndPut_99th_percentile": 0, "CheckAndPut_99.9th_percentile": 0, "SplitTime_num_ops": 0, "SplitTime_min": 0, "SplitTime_max": 0, "SplitTime_mean": 0, "SplitTime_25th_percentile": 0, "SplitTime_median": 0, "SplitTime_75th_percentile": 0, "SplitTime_90th_percentile": 0, "SplitTime_95th_percentile": 0, "SplitTime_98th_percentile": 0, "SplitTime_99th_percentile": 0, "SplitTime_99.9th_percentile": 0, "MajorCompactionOutputSize_num_ops": 0, "MajorCompactionOutputSize_min": 0, "MajorCompactionOutputSize_max": 0, "MajorCompactionOutputSize_mean": 0, "MajorCompactionOutputSize_25th_percentile": 0, "MajorCompactionOutputSize_median": 0, "MajorCompactionOutputSize_75th_percentile": 0, "MajorCompactionOutputSize_90th_percentile": 0, "MajorCompactionOutputSize_95th_percentile": 0, "MajorCompactionOutputSize_98th_percentile": 0, "MajorCompactionOutputSize_99th_percentile": 0, "MajorCompactionOutputSize_99.9th_percentile": 0, "majorCompactedInputBytes": 0, "slowAppendCount": 0, "flushedOutputBytes": 0, "CompactionOutputFileCount_num_ops": 0, "CompactionOutputFileCount_min": 0, "CompactionOutputFileCount_max": 0, "CompactionOutputFileCount_mean": 0, "CompactionOutputFileCount_25th_percentile": 0, "CompactionOutputFileCount_median": 0, "CompactionOutputFileCount_75th_percentile": 0, "CompactionOutputFileCount_90th_percentile": 0, "CompactionOutputFileCount_95th_percentile": 0, "CompactionOutputFileCount_98th_percentile": 0, "CompactionOutputFileCount_99th_percentile": 0, "CompactionOutputFileCount_99.9th_percentile": 0, "slowDeleteCount": 0, "Replay_num_ops": 0, "Replay_min": 0, "Replay_max": 0, "Replay_mean": 0, "Replay_25th_percentile": 0, "Replay_median": 0, "Replay_75th_percentile": 0, "Replay_90th_percentile": 0, "Replay_95th_percentile": 0, "Replay_98th_percentile": 0, "Replay_99th_percentile": 0, "Replay_99.9th_percentile": 0, "FlushTime_num_ops": 0, "FlushTime_min": 0, "FlushTime_max": 0, "FlushTime_mean": 0, "FlushTime_25th_percentile": 0, "FlushTime_median": 0, "FlushTime_75th_percentile": 0, "FlushTime_90th_percentile": 0, "FlushTime_95th_percentile": 0, "FlushTime_98th_percentile": 0, "FlushTime_99th_percentile": 0, "FlushTime_99.9th_percentile": 0, "MajorCompactionInputSize_num_ops": 0, "MajorCompactionInputSize_min": 0, "MajorCompactionInputSize_max": 0, "MajorCompactionInputSize_mean": 0, "MajorCompactionInputSize_25th_percentile": 0, "MajorCompactionInputSize_median": 0, "MajorCompactionInputSize_75th_percentile": 0, "MajorCompactionInputSize_90th_percentile": 0, "MajorCompactionInputSize_95th_percentile": 0, "MajorCompactionInputSize_98th_percentile": 0, "MajorCompactionInputSize_99th_percentile": 0, "MajorCompactionInputSize_99.9th_percentile": 0, "pauseInfoThresholdExceeded": 0, "splitSuccessCount": 0, "CheckAndDelete_num_ops": 0, "CheckAndDelete_min": 0, "CheckAndDelete_max": 0, "CheckAndDelete_mean": 0, "CheckAndDelete_25th_percentile": 0, "CheckAndDelete_median": 0, "CheckAndDelete_75th_percentile": 0, "CheckAndDelete_90th_percentile": 0, "CheckAndDelete_95th_percentile": 0, "CheckAndDelete_98th_percentile": 0, "CheckAndDelete_99th_percentile": 0, "CheckAndDelete_99.9th_percentile": 0, "CompactionInputSize_num_ops": 0, "CompactionInputSize_min": 0, "CompactionInputSize_max": 0, "CompactionInputSize_mean": 0, "CompactionInputSize_25th_percentile": 0, "CompactionInputSize_median": 0, "CompactionInputSize_75th_percentile": 0, "CompactionInputSize_90th_percentile": 0, "CompactionInputSize_95th_percentile": 0, "CompactionInputSize_98th_percentile": 0, "CompactionInputSize_99th_percentile": 0, "CompactionInputSize_99.9th_percentile": 0, "MajorCompactionOutputFileCount_num_ops": 0, "MajorCompactionOutputFileCount_min": 0, "MajorCompactionOutputFileCount_max": 0, "MajorCompactionOutputFileCount_mean": 0, "MajorCompactionOutputFileCount_25th_percentile": 0, "MajorCompactionOutputFileCount_median": 0, "MajorCompactionOutputFileCount_75th_percentile": 0, "MajorCompactionOutputFileCount_90th_percentile": 0, "MajorCompactionOutputFileCount_95th_percentile": 0, "MajorCompactionOutputFileCount_98th_percentile": 0, "MajorCompactionOutputFileCount_99th_percentile": 0, "MajorCompactionOutputFileCount_99.9th_percentile": 0, "ScanSize_num_ops": 0, "ScanSize_min": 0, "ScanSize_max": 0, "ScanSize_mean": 0, "ScanSize_25th_percentile": 0, "ScanSize_median": 0, "ScanSize_75th_percentile": 0, "ScanSize_90th_percentile": 0, "ScanSize_95th_percentile": 0, "ScanSize_98th_percentile": 0, "ScanSize_99th_percentile": 0, "ScanSize_99.9th_percentile": 0, "slowGetCount": 0, "flushedMemstoreBytes": 0, "CompactionOutputSize_num_ops": 0, "CompactionOutputSize_min": 0, "CompactionOutputSize_max": 0, "CompactionOutputSize_mean": 0, "CompactionOutputSize_25th_percentile": 0, "CompactionOutputSize_median": 0, "CompactionOutputSize_75th_percentile": 0, "CompactionOutputSize_90th_percentile": 0, "CompactionOutputSize_95th_percentile": 0, "CompactionOutputSize_98th_percentile": 0, "CompactionOutputSize_99th_percentile": 0, "CompactionOutputSize_99.9th_percentile": 0, "majorCompactedOutputBytes": 0, "PauseTimeWithoutGc_num_ops": 0, "PauseTimeWithoutGc_min": 0, "PauseTimeWithoutGc_max": 0, "PauseTimeWithoutGc_mean": 0, "PauseTimeWithoutGc_25th_percentile": 0, "PauseTimeWithoutGc_median": 0, "PauseTimeWithoutGc_75th_percentile": 0, "PauseTimeWithoutGc_90th_percentile": 0, "PauseTimeWithoutGc_95th_percentile": 0, "PauseTimeWithoutGc_98th_percentile": 0, "PauseTimeWithoutGc_99th_percentile": 0, "PauseTimeWithoutGc_99.9th_percentile": 0, "slowPutCount": 0, "slowIncrementCount": 0, "compactedInputBytes": 0, "Append_num_ops": 0, "Append_min": 0, "Append_max": 0, "Append_mean": 0, "Append_25th_percentile": 0, "Append_median": 0, "Append_75th_percentile": 0, "Append_90th_percentile": 0, "Append_95th_percentile": 0, "Append_98th_percentile": 0, "Append_99th_percentile": 0, "Append_99.9th_percentile": 0, "FlushOutputSize_num_ops": 0, "FlushOutputSize_min": 0, "FlushOutputSize_max": 0, "FlushOutputSize_mean": 0, "FlushOutputSize_25th_percentile": 0, "FlushOutputSize_median": 0, "FlushOutputSize_75th_percentile": 0, "FlushOutputSize_90th_percentile": 0, "FlushOutputSize_95th_percentile": 0, "FlushOutputSize_98th_percentile": 0, "FlushOutputSize_99th_percentile": 0, "FlushOutputSize_99.9th_percentile": 0, "Bulkload_count": 0, "Bulkload_mean_rate": 0.0, "Bulkload_1min_rate": 0.0, "Bulkload_5min_rate": 0.0, "Bulkload_15min_rate": 0.0, "Bulkload_num_ops": 0, "Bulkload_min": 0, "Bulkload_max": 0, "Bulkload_mean": 0, "Bulkload_25th_percentile": 0, "Bulkload_median": 0, "Bulkload_75th_percentile": 0, "Bulkload_90th_percentile": 0, "Bulkload_95th_percentile": 0, "Bulkload_98th_percentile": 0, "Bulkload_99th_percentile": 0, "Bulkload_99.9th_percentile": 0, "ServerReadQueryPerSecond_count": 79, "ServerReadQueryPerSecond_mean_rate": 12.8930723682373, "ServerReadQueryPerSecond_1min_rate": 7.800000000000001, "ServerReadQueryPerSecond_5min_rate": 7.800000000000001, "ServerReadQueryPerSecond_15min_rate": 7.800000000000001, "ServerWriteQueryPerSecond_count": 87, "ServerWriteQueryPerSecond_mean_rate": 14.198697729880138, "ServerWriteQueryPerSecond_1min_rate": 17.4, "ServerWriteQueryPerSecond_5min_rate": 17.4, "ServerWriteQueryPerSecond_15min_rate": 17.4 } ] } 2023-07-11 20:39:50,303 WARN [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44753] master.MasterRpcServices(612): jenkins-hbase5.apache.org,44935,1689107981188 reported a fatal error: ***** ABORTING region server jenkins-hbase5.apache.org,44935,1689107981188: Simulated kill ***** 2023-07-11 20:39:50,316 INFO [Listener at localhost/45761] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,44935,1689107981188' ***** 2023-07-11 20:39:50,316 INFO [Listener at localhost/45761] regionserver.HRegionServer(2311): STOPPED: Simulated kill 2023-07-11 20:39:50,316 INFO [RS:1;jenkins-hbase5:44935] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:39:50,316 INFO [RS:1;jenkins-hbase5:44935] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager abruptly. 2023-07-11 20:39:50,316 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:39:50,316 INFO [RS:1;jenkins-hbase5:44935] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager abruptly. 2023-07-11 20:39:50,318 DEBUG [RS:1;jenkins-hbase5:44935] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18ddedc4 to 127.0.0.1:57657 2023-07-11 20:39:50,318 DEBUG [RS:1;jenkins-hbase5:44935] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:39:50,319 INFO [Listener at localhost/45761] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:39:50,349 DEBUG [RS:1;jenkins-hbase5:44935] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:39:50,349 INFO [RS:1;jenkins-hbase5:44935] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:39:50,350 INFO [RS:1;jenkins-hbase5:44935] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:44935 2023-07-11 20:39:50,359 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:39:50,359 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:50,359 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:50,359 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 2023-07-11 20:39:50,359 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:39:50,359 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:39:50,359 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:39:50,360 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,44935,1689107981188] 2023-07-11 20:39:50,361 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,44935,1689107981188; numProcessing=1 2023-07-11 20:39:50,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:50,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:50,363 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,44935,1689107981188 already deleted, retry=false 2023-07-11 20:39:50,364 INFO [RegionServerTracker-0] master.ServerManager(568): Processing expiration of jenkins-hbase5.apache.org,44935,1689107981188 on jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:39:50,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:50,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:50,364 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 znode expired, triggering replicatorRemoved event 2023-07-11 20:39:50,364 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase5.apache.org,44935,1689107981188 znode expired, triggering replicatorRemoved event 2023-07-11 20:39:50,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:50,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:39:50,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:50,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:39:50,372 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:39:50,374 DEBUG [RegionServerTracker-0] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:39:50,375 INFO [RegionServerTracker-0] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=62 for jenkins-hbase5.apache.org,44935,1689107981188 (carryingMeta=true) jenkins-hbase5.apache.org,44935,1689107981188/CRASHED/regionCount=11/lock=java.util.concurrent.locks.ReentrantReadWriteLock@7cf5cd27[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-11 20:39:50,377 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:39:50,377 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:39:50,378 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:39:50,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:39:50,378 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:39:50,420 INFO [Listener at localhost/45761] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:39:50,424 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 0 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:39:50,425 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:39:50,425 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:39:50,426 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:39:50,428 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-11 20:39:50,428 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:39:50,429 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:39:50,429 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:39:50,429 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:39:50,430 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 20:39:50,435 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[] 2023-07-11 20:39:50,436 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:39:50,437 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:39:50,437 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:39:50,437 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:39:50,438 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:39:50,439 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:39:50,439 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:39:50,439 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 8 msec 2023-07-11 20:39:50,440 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:39:50,441 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,44935,1689107981188, table=hbase:meta, region=1588230740 2023-07-11 20:39:50,442 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108020442 2023-07-11 20:39:50,443 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:39:50,443 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:39:50,443 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:39:50,444 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:50,445 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:39:50,446 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true, isMeta: true 2023-07-11 20:39:50,449 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting 2023-07-11 20:39:50,450 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=1, meta=true 2023-07-11 20:39:50,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta}] 2023-07-11 20:39:50,455 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:39:50,455 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:39:50,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:39:50,455 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:39:50,522 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:39:50,522 INFO [RS:1;jenkins-hbase5:44935] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,44935,1689107981188; zookeeper connection closed. 2023-07-11 20:39:50,522 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:44935-0x101c1b924e40002, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:39:50,523 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2a494d8b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2a494d8b 2023-07-11 20:39:50,550 DEBUG [hconnection-0x3b52e725-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:39:50,753 DEBUG [hconnection-0x3b52e725-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:39:51,058 DEBUG [hconnection-0x3b52e725-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:39:51,240 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 20:39:51,240 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 20:39:51,565 DEBUG [hconnection-0x3b52e725-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:39:52,576 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:52,577 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:39:54,587 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:54,588 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:39:54,589 DEBUG [hconnection-0x3b52e725-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4146 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:58,613 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:39:58,614 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:39:58,615 DEBUG [hconnection-0x3b52e725-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8171 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:08,708 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:08,710 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:08,710 DEBUG [hconnection-0x3b52e725-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18267 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:18,729 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:18,730 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:18,730 DEBUG [hconnection-0x3b52e725-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28287 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:22,589 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase5.apache.org,44935,1689107981188 already deleted, retry=false 2023-07-11 20:40:28,803 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:28,804 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:28,804 DEBUG [hconnection-0x3b52e725-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38361 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:33,874 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase5.apache.org,44935,1689107981188 already deleted, retry=false 2023-07-11 20:40:38,807 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:38,808 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:38,808 DEBUG [hconnection-0x3b52e725-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48365 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:38,809 DEBUG [Listener at localhost/45761] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68367: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68367: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:38,810 WARN [Listener at localhost/45761] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T20:40:38.810Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68367: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68367: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 1 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:40:38,811 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:40:38,811 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:40:38,814 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-11 20:40:38,816 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0] 2023-07-11 20:40:38,817 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:40:38,817 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:40:38,818 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:40:38,818 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:40:38,819 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:40:38,820 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:40:38,820 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:40:38,820 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-11 20:40:38,824 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:40:38,825 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,44935,1689107981188, table=hbase:meta, region=1588230740 2023-07-11 20:40:38,826 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108068825 2023-07-11 20:40:38,827 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:40:38,827 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true, isMeta: true 2023-07-11 20:40:38,832 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=1, meta=true 2023-07-11 20:40:38,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta}] 2023-07-11 20:40:38,833 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:40:38,834 DEBUG [hconnection-0x3b52e725-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:40:38,842 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:40:38,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:40:38,936 DEBUG [hconnection-0x3b52e725-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:40:39,008 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42009] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=64 2023-07-11 20:40:39,031 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.WALSplitter(300): Splitting hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, size=54.9 K (56255bytes) 2023-07-11 20:40:39,032 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta 2023-07-11 20:40:39,037 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta after 5ms 2023-07-11 20:40:39,044 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.WALSplitter(311): Open hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta took 14ms 2023-07-11 20:40:39,059 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.WALSplitter(346): Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:40:39,068 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0-Writer-2] util.CommonFSUtils$DfsBuilderUtility(753): Could not find replicate method on builder; will not set replicate when creating output stream java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DistributedFileSystem$HdfsDataOutputStreamBuilder.replicate() at java.lang.Class.getMethod(Class.java:1786) at org.apache.hadoop.hbase.util.CommonFSUtils$DfsBuilderUtility.(CommonFSUtils.java:750) at org.apache.hadoop.hbase.util.CommonFSUtils.createForWal(CommonFSUtils.java:802) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.initOutput(ProtobufLogWriter.java:102) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:78) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.createRecoveredEditsWriter(WALFactory.java:402) at org.apache.hadoop.hbase.wal.WALSplitter.createWriter(WALSplitter.java:516) at org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink.createRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.java:69) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.getRecoveredEditsWriter(RecoveredEditsOutputSink.java:81) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.append(RecoveredEditsOutputSink.java:63) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.writeBuffer(OutputSink.java:249) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.doRun(OutputSink.java:241) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.run(OutputSink.java:211) 2023-07-11 20:40:39,068 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta so closing down 2023-07-11 20:40:39,068 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-11 20:40:39,072 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta.temp 2023-07-11 20:40:39,075 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-11 20:40:39,094 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) 2023-07-11 20:40:39,096 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 20:40:39,096 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.WALSplitter(423): Processed 61 edits across 1 Regions in 51 ms; skipped=1; WAL=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, size=54.9 K, length=56255, corrupted=false, cancelled=false 2023-07-11 20:40:39,097 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, journal: Splitting hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, size=54.9 K (56255bytes) at 1689108039032Finishing writing output for hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta so closing down at 1689108039068 (+36 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta.temp at 1689108039072 (+4 ms)3 split writer threads finished at 1689108039075 (+3 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) at 1689108039094 (+19 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 at 1689108039096 (+2 ms)Processed 61 edits across 1 Regions in 51 ms; skipped=1; WAL=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, size=54.9 K, length=56255, corrupted=false, cancelled=false at 1689108039097 (+1 ms) 2023-07-11 20:40:39,097 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta 2023-07-11 20:40:39,099 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=64 2023-07-11 20:40:39,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.HMaster(3641): Remote procedure done, pid=64 2023-07-11 20:40:39,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] wal.WALSplitUtil(141): Moved hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs 2023-07-11 20:40:39,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-11 20:40:39,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 in 266 msec 2023-07-11 20:40:39,112 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:40:39,114 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=62 2023-07-11 20:40:39,114 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 in 279 msec 2023-07-11 20:40:39,117 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting dir is empty, no logs to split. 2023-07-11 20:40:39,117 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=0, meta=true 2023-07-11 20:40:39,117 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase5.apache.org,44935,1689107981188 WAL splitting is done? wals=0, meta=true 2023-07-11 20:40:39,117 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:40:39,117 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:40:39,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:40:39,117 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:40:39,138 DEBUG [hconnection-0x3b52e725-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:40:39,440 DEBUG [hconnection-0x3b52e725-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:40:39,942 DEBUG [hconnection-0x3b52e725-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:40:40,953 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:40,954 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:42,967 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:42,969 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:42,969 DEBUG [hconnection-0x3b52e725-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4135 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:46,987 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:46,988 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:46,988 DEBUG [hconnection-0x3b52e725-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8154 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:57,076 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:40:57,077 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:40:57,077 DEBUG [hconnection-0x3b52e725-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18243 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:07,134 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:07,135 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:07,136 DEBUG [hconnection-0x3b52e725-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28301 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:17,212 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:17,213 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:17,213 DEBUG [hconnection-0x3b52e725-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38379 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:27,313 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:27,314 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:27,314 DEBUG [hconnection-0x3b52e725-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48480 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:27,315 DEBUG [Listener at localhost/45761] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68594: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68594: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:27,316 WARN [Listener at localhost/45761] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T20:41:27.316Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68594: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68594: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:27,316 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 2 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:41:27,316 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:41:27,316 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:41:27,316 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:41:27,316 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:41:27,317 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:41:27,317 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:41:27,317 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:41:27,317 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:41:27,319 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 20:41:27,320 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1] 2023-07-11 20:41:27,320 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 20:41:27,320 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 20:41:27,321 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:41:27,321 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:41:27,321 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:41:27,321 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:41:27,322 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:41:27,323 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:41:27,323 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:41:27,323 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:41:27,323 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:41:27,323 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:41:27,323 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:41:27,323 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-07-11 20:41:27,324 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:41:27,325 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,44935,1689107981188, table=hbase:meta, region=1588230740 2023-07-11 20:41:27,325 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108117325 2023-07-11 20:41:27,326 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:41:27,327 DEBUG [hconnection-0x3b52e725-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:41:27,328 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting dir is empty, no logs to split. 2023-07-11 20:41:27,328 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=0, meta=true 2023-07-11 20:41:27,328 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase5.apache.org,44935,1689107981188 WAL splitting is done? wals=0, meta=true 2023-07-11 20:41:27,328 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:41:27,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 20:41:27,330 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:41:27,330 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:41:27,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:41:27,330 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:41:27,429 DEBUG [hconnection-0x3b52e725-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:41:27,632 DEBUG [hconnection-0x3b52e725-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:41:27,936 DEBUG [hconnection-0x3b52e725-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:41:28,441 DEBUG [hconnection-0x3b52e725-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:41:29,443 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:29,444 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:31,447 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:31,448 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:31,448 DEBUG [hconnection-0x3b52e725-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4121 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:35,487 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:35,488 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:35,488 DEBUG [hconnection-0x3b52e725-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8161 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:43,290 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-11 20:41:45,542 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:45,543 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:45,544 DEBUG [hconnection-0x3b52e725-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18216 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:55,574 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:41:55,577 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:41:55,577 DEBUG [hconnection-0x3b52e725-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28250 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:05,660 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:05,661 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:42:05,661 DEBUG [hconnection-0x3b52e725-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38334 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:15,722 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:15,723 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:42:15,723 DEBUG [hconnection-0x3b52e725-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48396 ms ago, cancelled=false, msg=Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:15,724 DEBUG [Listener at localhost/45761] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68420: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68420: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:15,725 WARN [Listener at localhost/45761] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T20:42:15.725Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68420: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68420: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase5.apache.org,44935,1689107981188, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase5.apache.org/172.31.10.131:44935 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:15,726 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 3 exec state=pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:15,726 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:42:15,726 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:42:15,726 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:42:15,726 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:42:15,726 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:42:15,726 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:42:15,726 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:42:15,727 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:42:15,736 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 9 msec 2023-07-11 20:42:15,738 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7] 2023-07-11 20:42:15,738 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 20:42:15,738 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 20:42:15,738 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:42:15,739 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:42:15,739 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:42:15,746 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:42:15,748 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:42:15,748 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:15,748 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:15,748 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:15,749 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:42:15,749 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:15,749 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:15,749 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 12 msec 2023-07-11 20:42:15,750 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:42:15,750 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,44935,1689107981188, table=hbase:meta, region=1588230740 2023-07-11 20:42:15,755 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108165755 2023-07-11 20:42:15,755 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:42:15,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 20:42:15,761 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:42:15,773 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:42:15,773 DEBUG [hconnection-0x3b52e725-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:15,774 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:15,875 DEBUG [hconnection-0x3b52e725-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:15,924 DEBUG [jenkins-hbase5:44753] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-11 20:42:15,924 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:42:15,925 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:42:15,925 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:42:15,925 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:42:15,926 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,42009,1689107981238, state=OPENING 2023-07-11 20:42:15,927 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 20:42:15,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:15,927 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:42:16,078 WARN [ReadOnlyZKClient-127.0.0.1:57657@0x35fd0e3f] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-11 20:42:16,079 DEBUG [hconnection-0x3b52e725-shared-pool-8] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:42:16,082 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:34700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:42:16,083 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42009] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Scan size: 97 connection: 172.31.10.131:34700 deadline: 1689108195776, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,087 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 20:42:16,087 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:42:16,089 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C42009%2C1689107981238.meta, suffix=.meta, logDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,42009,1689107981238, archiveDir=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs, maxLogs=32 2023-07-11 20:42:16,108 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK] 2023-07-11 20:42:16,108 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK] 2023-07-11 20:42:16,109 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK] 2023-07-11 20:42:16,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,42009,1689107981238/jenkins-hbase5.apache.org%2C42009%2C1689107981238.meta.1689108136090.meta 2023-07-11 20:42:16,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43357,DS-ef5a015d-a01c-490d-84a1-931660a65ca7,DISK], DatanodeInfoWithStorage[127.0.0.1:34715,DS-2860b740-1f53-49d5-b065-61efe7523860,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-1ad9a0fb-2651-492a-828c-4ab87d1514cf,DISK]] 2023-07-11 20:42:16,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:42:16,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 20:42:16,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 20:42:16,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 20:42:16,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 20:42:16,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:16,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 20:42:16,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 20:42:16,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 20:42:16,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info 2023-07-11 20:42:16,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info 2023-07-11 20:42:16,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 20:42:16,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:16,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 20:42:16,123 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:42:16,123 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:42:16,124 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 20:42:16,124 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:16,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 20:42:16,126 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/table 2023-07-11 20:42:16,126 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/table 2023-07-11 20:42:16,126 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 20:42:16,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:16,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740 2023-07-11 20:42:16,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740 2023-07-11 20:42:16,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 20:42:16,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 274, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=63, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 20:42:16,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=51.43 KB heapSize=72.08 KB 2023-07-11 20:42:16,211 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=51.14 KB at sequenceid=63 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/.tmp/info/c8ce02f77f124f1da8fdf880cb3d5e9c 2023-07-11 20:42:16,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=296 B at sequenceid=63 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/.tmp/table/309da8502a36428f8c2f49b5c467104c 2023-07-11 20:42:16,274 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/.tmp/info/c8ce02f77f124f1da8fdf880cb3d5e9c as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info/c8ce02f77f124f1da8fdf880cb3d5e9c 2023-07-11 20:42:16,281 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info/c8ce02f77f124f1da8fdf880cb3d5e9c, entries=270, sequenceid=63, filesize=57.3 K 2023-07-11 20:42:16,283 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/.tmp/table/309da8502a36428f8c2f49b5c467104c as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/table/309da8502a36428f8c2f49b5c467104c 2023-07-11 20:42:16,289 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/table/309da8502a36428f8c2f49b5c467104c, entries=4, sequenceid=63, filesize=4.9 K 2023-07-11 20:42:16,290 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~51.43 KB/52664, heapSize ~71.80 KB/73520, currentSize=0 B/0 for 1588230740 in 148ms, sequenceid=63, compaction requested=false; wal=null 2023-07-11 20:42:16,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 20:42:16,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:16,297 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 20:42:16,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=1 2023-07-11 20:42:16,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=64; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62685667, jitterRate=-0.06591077148914337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:16,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 20:42:16,305 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=66, masterSystemTime=1689108136079 2023-07-11 20:42:16,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 20:42:16,307 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 20:42:16,308 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,42009,1689107981238, state=OPEN 2023-07-11 20:42:16,309 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 20:42:16,309 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:42:16,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-11 20:42:16,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 in 382 msec 2023-07-11 20:42:16,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=62 2023-07-11 20:42:16,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 550 msec 2023-07-11 20:42:16,426 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,426 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=032d0495ec0964438e1a1750441fa9f9, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,427 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,427 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=2ca9cb0f701c87260f2be41ccb924558, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,427 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,427 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=126966e5d395a2142294de9a3be86ebf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,428 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,428 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=4e500486342518ff5692418f30fc7f83, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,428 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=271710c1c9bb963a3440ef4a722e1452, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,428 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,429 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,429 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,429 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=fe2b95730f173e86f1c38a731479321f, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,429 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=252836bab05fe1e164f33265af5a41a2, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,430 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=f8703bfd69cad775e76710af34863a09, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,430 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=34c7c2230412431453d1e48ace10e600, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,430 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,430 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,431 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=950bc72614c9a8a43882ca9374cd68b1, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,431 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1c6c57adadf49aca13384cc30abb8442, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,431 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,431 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,432 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=8e8a887c1dfba3387c203eaa29970d81, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,432 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=bb68c30b67501f47ae63c14ce057756a, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,432 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,433 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,433 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=80ec0d0a545f169fdf6bee237db4b021, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,433 INFO [Listener at localhost/45761] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 20:42:16,433 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689108196433 2023-07-11 20:42:16,433 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689108256433 2023-07-11 20:42:16,433 INFO [Listener at localhost/45761] assignment.AssignmentManager(1536): Joined the cluster in 677 msec 2023-07-11 20:42:16,434 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase5.apache.org,44935,1689107981188 had 11 regions 2023-07-11 20:42:16,434 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:42:16,434 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:16,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:42:16,434 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 4 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:42:16,684 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:42:16,684 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:42:16,686 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 20:42:16,687 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14] 2023-07-11 20:42:16,688 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 20:42:16,688 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 20:42:16,688 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 20:42:16,688 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 20:42:16,688 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:42:16,689 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:42:16,689 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:42:16,689 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:42:16,690 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,691 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,692 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 20:42:16,692 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:42:16,693 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,42009,1689107981238, table=hbase:meta, region=1588230740 2023-07-11 20:42:16,693 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108166693 2023-07-11 20:42:16,693 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:42:16,700 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,700 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=032d0495ec0964438e1a1750441fa9f9, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,700 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,700 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=2ca9cb0f701c87260f2be41ccb924558, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,701 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,701 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=126966e5d395a2142294de9a3be86ebf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,701 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,701 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=4e500486342518ff5692418f30fc7f83, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,701 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=271710c1c9bb963a3440ef4a722e1452, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,701 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,702 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,702 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,702 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=fe2b95730f173e86f1c38a731479321f, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,702 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=252836bab05fe1e164f33265af5a41a2, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,702 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=f8703bfd69cad775e76710af34863a09, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,702 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=34c7c2230412431453d1e48ace10e600, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,702 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,703 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,703 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=950bc72614c9a8a43882ca9374cd68b1, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,703 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1c6c57adadf49aca13384cc30abb8442, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,703 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,703 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,704 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=8e8a887c1dfba3387c203eaa29970d81, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,704 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=bb68c30b67501f47ae63c14ce057756a, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,704 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,704 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,704 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=80ec0d0a545f169fdf6bee237db4b021, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,704 INFO [Listener at localhost/45761] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 20:42:16,704 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689108196704 2023-07-11 20:42:16,704 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689108256704 2023-07-11 20:42:16,704 INFO [Listener at localhost/45761] assignment.AssignmentManager(1536): Joined the cluster in 10 msec 2023-07-11 20:42:16,705 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase5.apache.org,44935,1689107981188 had 10 regions 2023-07-11 20:42:16,705 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:42:16,706 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true, isMeta: false 2023-07-11 20:42:16,708 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=1, meta=false 2023-07-11 20:42:16,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396}] 2023-07-11 20:42:16,708 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:42:16,708 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:16,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:42:16,708 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 5 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:42:16,955 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:42:16,955 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:42:16,956 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 20:42:16,958 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16] 2023-07-11 20:42:16,958 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 20:42:16,958 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 20:42:16,958 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 20:42:16,958 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 20:42:16,959 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:42:16,959 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:42:16,960 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:42:16,960 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:42:16,961 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:42:16,962 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:16,962 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,962 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,962 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:42:16,962 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,962 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:42:16,962 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,963 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,963 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,963 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:16,963 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-11 20:42:16,964 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:42:16,964 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,42009,1689107981238, table=hbase:meta, region=1588230740 2023-07-11 20:42:16,965 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108166965 2023-07-11 20:42:16,966 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:42:16,971 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,971 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=032d0495ec0964438e1a1750441fa9f9, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,972 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,972 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=2ca9cb0f701c87260f2be41ccb924558, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,972 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,972 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=126966e5d395a2142294de9a3be86ebf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,972 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,972 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=4e500486342518ff5692418f30fc7f83, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,973 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=271710c1c9bb963a3440ef4a722e1452, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,973 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,973 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,973 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,973 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=fe2b95730f173e86f1c38a731479321f, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,973 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=252836bab05fe1e164f33265af5a41a2, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,974 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=f8703bfd69cad775e76710af34863a09, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,974 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=34c7c2230412431453d1e48ace10e600, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,974 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,974 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,975 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=950bc72614c9a8a43882ca9374cd68b1, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,975 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1c6c57adadf49aca13384cc30abb8442, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,975 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,975 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,975 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=8e8a887c1dfba3387c203eaa29970d81, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,975 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=bb68c30b67501f47ae63c14ce057756a, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,976 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:16,976 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:16,976 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=80ec0d0a545f169fdf6bee237db4b021, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:16,976 INFO [Listener at localhost/45761] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 20:42:16,976 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689108196976 2023-07-11 20:42:16,976 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689108256976 2023-07-11 20:42:16,977 INFO [Listener at localhost/45761] assignment.AssignmentManager(1536): Joined the cluster in 10 msec 2023-07-11 20:42:16,977 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true, isMeta: false 2023-07-11 20:42:16,979 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=1, meta=false 2023-07-11 20:42:16,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396}] 2023-07-11 20:42:16,980 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:42:16,982 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:16,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:17,136 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42009] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=68 2023-07-11 20:42:17,157 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(300): Splitting hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, size=327.7 K (335552bytes) 2023-07-11 20:42:17,157 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 2023-07-11 20:42:17,157 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 after 0ms 2023-07-11 20:42:17,164 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(311): Open hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 took 8ms 2023-07-11 20:42:17,167 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for c8518b9630dfef8e8a84f34bffa19948: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,176 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for 3ad8434b03fda3dc4758a9fb74cfdc5d: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,177 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for 771db035f4c5dc0d7b474b119c9c3a12: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,178 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,179 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for ecacbcb0936c91836cd6ad725ff995f7: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,180 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for e6cc1f00c76bab58b5f481134121b510: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,181 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for b0ceba1adb699bcddcac5c4ff683a7d5: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,182 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for ef1ae4440e8f6d786a2521b3b820205c: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,183 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for 9d47696c41005c80caeeaa85fe4aebdf: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,184 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for f8703bfd69cad775e76710af34863a09: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,185 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(346): Last flushed sequenceid for ec622bf0b15287b4631102fc291dead5: last_flushed_sequence_id: 18446744073709551615 2023-07-11 20:42:17,200 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,203 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,207 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,209 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(400): Finishing writing output for hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 so closing down 2023-07-11 20:42:17,209 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-11 20:42:17,223 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,232 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,239 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,251 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,252 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,256 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp 2023-07-11 20:42:17,257 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.OutputSink(146): 3 split writer threads finished 2023-07-11 20:42:17,381 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 20:42:17,384 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004 2023-07-11 20:42:17,390 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 4 ms) 2023-07-11 20:42:17,396 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004 2023-07-11 20:42:17,405 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 20:42:17,408 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004 2023-07-11 20:42:17,481 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 20:42:17,481 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 2 edits, skipped 0 edits in 0 ms) 2023-07-11 20:42:17,483 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004 2023-07-11 20:42:17,485 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000005 2023-07-11 20:42:17,504 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-11 20:42:17,505 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004 2023-07-11 20:42:17,525 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 20:42:17,527 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004 2023-07-11 20:42:17,551 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 20:42:17,553 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004 2023-07-11 20:42:17,844 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 4 ms) 2023-07-11 20:42:17,846 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004 2023-07-11 20:42:17,903 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 20:42:17,905 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004 2023-07-11 20:42:17,905 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(423): Processed 21 edits across 10 Regions in 740 ms; skipped=10; WAL=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, size=327.7 K, length=335552, corrupted=false, cancelled=false 2023-07-11 20:42:17,905 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] wal.WALSplitter(426): Completed split of hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, journal: Splitting hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, size=327.7 K (335552bytes) at 1689108137157Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137178 (+21 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137200 (+22 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137203 (+3 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137207 (+4 ms)Split 11 edits, skipped 10 edits. at 1689108137209 (+2 ms)Finishing writing output for hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 so closing down at 1689108137209Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137223 (+14 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137232 (+9 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137239 (+7 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137251 (+12 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137252 (+1 ms)Creating recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp at 1689108137256 (+4 ms)3 split writer threads finished at 1689108137257 (+1 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689108137381 (+124 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004 at 1689108137384 (+3 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 4 ms) at 1689108137390 (+6 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004 at 1689108137396 (+6 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689108137405 (+9 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004 at 1689108137408 (+3 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689108137481 (+73 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 2 edits, skipped 0 edits in 0 ms) at 1689108137481Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004 at 1689108137483 (+2 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000005 at 1689108137485 (+2 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689108137504 (+19 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004 at 1689108137505 (+1 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689108137525 (+20 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004 at 1689108137527 (+2 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689108137551 (+24 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004 at 1689108137553 (+2 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 4 ms) at 1689108137844 (+291 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004 at 1689108137846 (+2 ms)Closed recovered edits writer path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689108137903 (+57 ms)Rename recovered edits hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004-jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396.temp to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004 at 1689108137905 (+2 ms)Processed 21 edits across 10 Regions in 740 ms; skipped=10; WAL=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, size=327.7 K, length=335552, corrupted=false, cancelled=false at 1689108137905 2023-07-11 20:42:17,905 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 2023-07-11 20:42:17,905 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0-1] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=68 2023-07-11 20:42:17,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] master.HMaster(3641): Remote procedure done, pid=68 2023-07-11 20:42:17,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44753] wal.WALSplitUtil(141): Moved hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting/jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396 to hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs 2023-07-11 20:42:17,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-11 20:42:17,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 in 926 msec 2023-07-11 20:42:17,912 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:17,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=62 2023-07-11 20:42:17,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 in 933 msec 2023-07-11 20:42:17,915 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting dir is empty, no logs to split. 2023-07-11 20:42:17,915 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=0, meta=false 2023-07-11 20:42:17,915 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase5.apache.org,44935,1689107981188 WAL splitting is done? wals=0, meta=false 2023-07-11 20:42:17,916 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:42:17,916 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:17,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:42:17,916 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:42:17,977 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 6 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:17,977 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:42:17,977 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:42:17,978 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:42:17,979 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:42:17,979 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:42:17,979 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:42:17,979 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:42:17,979 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:42:17,980 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 20:42:17,981 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18] 2023-07-11 20:42:17,981 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 20:42:17,981 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 20:42:17,981 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 20:42:17,981 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 20:42:17,981 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 20:42:17,981 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 20:42:17,982 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:42:17,982 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:42:17,982 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:42:17,983 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:42:17,984 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:42:17,984 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:17,985 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:17,986 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 20:42:17,986 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:42:17,987 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,42009,1689107981238, table=hbase:meta, region=1588230740 2023-07-11 20:42:17,987 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108167987 2023-07-11 20:42:17,989 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:42:17,994 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,994 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=032d0495ec0964438e1a1750441fa9f9, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,994 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,994 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=2ca9cb0f701c87260f2be41ccb924558, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,994 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,994 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=126966e5d395a2142294de9a3be86ebf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,995 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,995 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=4e500486342518ff5692418f30fc7f83, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,995 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=271710c1c9bb963a3440ef4a722e1452, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,995 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,995 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,995 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,995 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=fe2b95730f173e86f1c38a731479321f, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=252836bab05fe1e164f33265af5a41a2, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=f8703bfd69cad775e76710af34863a09, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=34c7c2230412431453d1e48ace10e600, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=950bc72614c9a8a43882ca9374cd68b1, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1c6c57adadf49aca13384cc30abb8442, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,996 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,997 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,997 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=8e8a887c1dfba3387c203eaa29970d81, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,997 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=bb68c30b67501f47ae63c14ce057756a, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,997 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:17,997 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:17,997 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=80ec0d0a545f169fdf6bee237db4b021, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:17,997 INFO [Listener at localhost/45761] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 20:42:17,997 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689108197997 2023-07-11 20:42:17,997 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689108257997 2023-07-11 20:42:17,997 INFO [Listener at localhost/45761] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-11 20:42:17,999 INFO [PEWorker-1] master.MasterWalManager(320): Log dir for server jenkins-hbase5.apache.org,44935,1689107981188 does not exist 2023-07-11 20:42:17,999 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase5.apache.org,44935,1689107981188 WAL count=0, meta=false 2023-07-11 20:42:17,999 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase5.apache.org,44935,1689107981188 WAL splitting is done? wals=0, meta=false 2023-07-11 20:42:18,000 INFO [PEWorker-1] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase5.apache.org,44935,1689107981188 failed, ignore...File hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/WALs/jenkins-hbase5.apache.org,44935,1689107981188-splitting does not exist. 2023-07-11 20:42:18,000 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:42:18,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN}, {pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN}] 2023-07-11 20:42:18,002 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:42:18,002 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:18,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:42:18,002 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:42:18,248 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 7 exec state=pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:18,248 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:42:18,248 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:42:18,248 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:42:18,248 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:42:18,248 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:42:18,248 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:42:18,248 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:42:18,249 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:42:18,249 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 20:42:18,250 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25] 2023-07-11 20:42:18,250 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 20:42:18,250 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 20:42:18,250 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 20:42:18,250 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 20:42:18,251 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 20:42:18,251 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 20:42:18,251 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:42:18,252 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:42:18,252 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:42:18,252 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:42:18,253 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:42:18,254 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:18,254 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,254 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,254 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:18,255 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:18,255 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 20:42:18,256 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:42:18,256 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,42009,1689107981238, table=hbase:meta, region=1588230740 2023-07-11 20:42:18,257 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108168257 2023-07-11 20:42:18,257 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:42:18,262 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,262 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=032d0495ec0964438e1a1750441fa9f9, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,262 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,262 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=2ca9cb0f701c87260f2be41ccb924558, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,262 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,262 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=126966e5d395a2142294de9a3be86ebf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,262 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,263 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=4e500486342518ff5692418f30fc7f83, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,263 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=271710c1c9bb963a3440ef4a722e1452, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,263 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,263 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,263 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,263 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=fe2b95730f173e86f1c38a731479321f, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,263 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=252836bab05fe1e164f33265af5a41a2, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=f8703bfd69cad775e76710af34863a09, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=34c7c2230412431453d1e48ace10e600, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=950bc72614c9a8a43882ca9374cd68b1, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1c6c57adadf49aca13384cc30abb8442, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,264 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,265 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=8e8a887c1dfba3387c203eaa29970d81, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,265 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=bb68c30b67501f47ae63c14ce057756a, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,265 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,44935,1689107981188, regionLocation=jenkins-hbase5.apache.org,44935,1689107981188, openSeqNum=2 2023-07-11 20:42:18,265 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:18,265 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=80ec0d0a545f169fdf6bee237db4b021, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:18,265 INFO [Listener at localhost/45761] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 20:42:18,265 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689108198265 2023-07-11 20:42:18,265 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689108258265 2023-07-11 20:42:18,265 INFO [Listener at localhost/45761] assignment.AssignmentManager(1536): Joined the cluster in 7 msec 2023-07-11 20:42:18,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN}, {pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN}] 2023-07-11 20:42:18,267 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:42:18,268 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN 2023-07-11 20:42:18,269 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,270 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN 2023-07-11 20:42:18,270 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,271 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN 2023-07-11 20:42:18,271 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,272 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN 2023-07-11 20:42:18,273 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,273 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN 2023-07-11 20:42:18,274 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,274 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN 2023-07-11 20:42:18,275 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,276 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN 2023-07-11 20:42:18,276 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,277 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN 2023-07-11 20:42:18,277 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,278 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN 2023-07-11 20:42:18,278 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,279 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN 2023-07-11 20:42:18,279 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 20:42:18,419 DEBUG [jenkins-hbase5:44753] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-11 20:42:18,419 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:42:18,420 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:42:18,420 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:42:18,420 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:42:18,420 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:42:18,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=c8518b9630dfef8e8a84f34bffa19948, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,421 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:42:18,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689108138420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138420"}]},"ts":"1689108138420"} 2023-07-11 20:42:18,421 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:42:18,421 DEBUG [jenkins-hbase5:44753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:42:18,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=79, ppid=71, state=RUNNABLE; OpenRegionProcedure c8518b9630dfef8e8a84f34bffa19948, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:18,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=78 updating hbase:meta row=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138430"}]},"ts":"1689108138430"} 2023-07-11 20:42:18,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=78, state=RUNNABLE; OpenRegionProcedure 9d47696c41005c80caeeaa85fe4aebdf, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:18,436 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=ec622bf0b15287b4631102fc291dead5, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,437 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138436"}]},"ts":"1689108138436"} 2023-07-11 20:42:18,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=69, state=RUNNABLE; OpenRegionProcedure ec622bf0b15287b4631102fc291dead5, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:18,442 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=f8703bfd69cad775e76710af34863a09, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,442 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138441"}]},"ts":"1689108138441"} 2023-07-11 20:42:18,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=74, state=RUNNABLE; OpenRegionProcedure f8703bfd69cad775e76710af34863a09, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:18,447 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,447 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138447"}]},"ts":"1689108138447"} 2023-07-11 20:42:18,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=77, state=RUNNABLE; OpenRegionProcedure ecacbcb0936c91836cd6ad725ff995f7, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:18,454 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e6cc1f00c76bab58b5f481134121b510, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,455 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138454"}]},"ts":"1689108138454"} 2023-07-11 20:42:18,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=76, state=RUNNABLE; OpenRegionProcedure e6cc1f00c76bab58b5f481134121b510, server=jenkins-hbase5.apache.org,42009,1689107981238}] 2023-07-11 20:42:18,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:18,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138459"}]},"ts":"1689108138459"} 2023-07-11 20:42:18,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=72, state=RUNNABLE; OpenRegionProcedure ef1ae4440e8f6d786a2521b3b820205c, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:42:18,469 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:18,469 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138469"}]},"ts":"1689108138469"} 2023-07-11 20:42:18,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=86, ppid=73, state=RUNNABLE; OpenRegionProcedure b0ceba1adb699bcddcac5c4ff683a7d5, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:42:18,473 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:18,473 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138473"}]},"ts":"1689108138473"} 2023-07-11 20:42:18,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=75, state=RUNNABLE; OpenRegionProcedure 3ad8434b03fda3dc4758a9fb74cfdc5d, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:42:18,477 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:18,477 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138477"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689108138477"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689108138477"}]},"ts":"1689108138477"} 2023-07-11 20:42:18,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=70, state=RUNNABLE; OpenRegionProcedure 771db035f4c5dc0d7b474b119c9c3a12, server=jenkins-hbase5.apache.org,41489,1689107981112}] 2023-07-11 20:42:18,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:18,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecacbcb0936c91836cd6ad725ff995f7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-11 20:42:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,585 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,586 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:18,586 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8518b9630dfef8e8a84f34bffa19948, NAME => 'hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:42:18,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:18,587 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily11 2023-07-11 20:42:18,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,587 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily11 2023-07-11 20:42:18,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:18,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:18,587 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecacbcb0936c91836cd6ad725ff995f7 columnFamilyName colfamily11 2023-07-11 20:42:18,588 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(310): Store=ecacbcb0936c91836cd6ad725ff995f7/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,588 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,588 INFO [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:18,589 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily21 2023-07-11 20:42:18,589 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily21 2023-07-11 20:42:18,589 DEBUG [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/info 2023-07-11 20:42:18,589 DEBUG [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/info 2023-07-11 20:42:18,589 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecacbcb0936c91836cd6ad725ff995f7 columnFamilyName colfamily21 2023-07-11 20:42:18,589 INFO [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8518b9630dfef8e8a84f34bffa19948 columnFamilyName info 2023-07-11 20:42:18,590 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(310): Store=ecacbcb0936c91836cd6ad725ff995f7/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,590 INFO [StoreOpener-c8518b9630dfef8e8a84f34bffa19948-1] regionserver.HStore(310): Store=c8518b9630dfef8e8a84f34bffa19948/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,590 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:18,591 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily31 2023-07-11 20:42:18,591 DEBUG [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily31 2023-07-11 20:42:18,592 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecacbcb0936c91836cd6ad725ff995f7 columnFamilyName colfamily31 2023-07-11 20:42:18,592 INFO [StoreOpener-ecacbcb0936c91836cd6ad725ff995f7-1] regionserver.HStore(310): Store=ecacbcb0936c91836cd6ad725ff995f7/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:18,595 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000005 2023-07-11 20:42:18,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004 2023-07-11 20:42:18,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 2, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=5, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000005 2023-07-11 20:42:18,598 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing c8518b9630dfef8e8a84f34bffa19948 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 20:42:18,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004 2023-07-11 20:42:18,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing ecacbcb0936c91836cd6ad725ff995f7 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:18,619 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:33722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:42:18,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:18,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef1ae4440e8f6d786a2521b3b820205c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-11 20:42:18,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,630 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,632 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily11 2023-07-11 20:42:18,632 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily11 2023-07-11 20:42:18,633 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef1ae4440e8f6d786a2521b3b820205c columnFamilyName colfamily11 2023-07-11 20:42:18,633 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(310): Store=ef1ae4440e8f6d786a2521b3b820205c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,633 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,634 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily21 2023-07-11 20:42:18,635 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily21 2023-07-11 20:42:18,635 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef1ae4440e8f6d786a2521b3b820205c columnFamilyName colfamily21 2023-07-11 20:42:18,636 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(310): Store=ef1ae4440e8f6d786a2521b3b820205c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,636 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,637 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily31 2023-07-11 20:42:18,637 DEBUG [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily31 2023-07-11 20:42:18,637 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef1ae4440e8f6d786a2521b3b820205c columnFamilyName colfamily31 2023-07-11 20:42:18,638 INFO [StoreOpener-ef1ae4440e8f6d786a2521b3b820205c-1] regionserver.HStore(310): Store=ef1ae4440e8f6d786a2521b3b820205c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004 2023-07-11 20:42:18,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/.tmp/colfamily11/0354f00d573b42c2a789f960d6d197c1 2023-07-11 20:42:18,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004 2023-07-11 20:42:18,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing ef1ae4440e8f6d786a2521b3b820205c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:18,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/.tmp/info/2271bb9c5b6c4ba3a99c7fff72d80ad2 2023-07-11 20:42:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/.tmp/colfamily11/0354f00d573b42c2a789f960d6d197c1 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily11/0354f00d573b42c2a789f960d6d197c1 2023-07-11 20:42:18,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/.tmp/info/2271bb9c5b6c4ba3a99c7fff72d80ad2 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/info/2271bb9c5b6c4ba3a99c7fff72d80ad2 2023-07-11 20:42:18,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/colfamily11/0354f00d573b42c2a789f960d6d197c1, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:18,693 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/info/2271bb9c5b6c4ba3a99c7fff72d80ad2, entries=2, sequenceid=5, filesize=4.8 K 2023-07-11 20:42:18,696 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c8518b9630dfef8e8a84f34bffa19948 in 98ms, sequenceid=5, compaction requested=false; wal=null 2023-07-11 20:42:18,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ecacbcb0936c91836cd6ad725ff995f7 in 92ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:18,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/0000000000000000004 2023-07-11 20:42:18,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/0000000000000000005 2023-07-11 20:42:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:18,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:18,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:18,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:18,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=1 2023-07-11 20:42:18,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ecacbcb0936c91836cd6ad725ff995f7; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65461391, jitterRate=-0.02454926073551178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:18,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ecacbcb0936c91836cd6ad725ff995f7: 2023-07-11 20:42:18,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c8518b9630dfef8e8a84f34bffa19948; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67959025, jitterRate=0.012668386101722717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:42:18,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c8518b9630dfef8e8a84f34bffa19948: 2023-07-11 20:42:18,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7., pid=83, masterSystemTime=1689108138579 2023-07-11 20:42:18,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:18,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:18,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:18,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948., pid=79, masterSystemTime=1689108138579 2023-07-11 20:42:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6cc1f00c76bab58b5f481134121b510, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-11 20:42:18,725 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,725 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138725"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108138725"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108138725"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108138725"}]},"ts":"1689108138725"} 2023-07-11 20:42:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,732 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,733 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily11 2023-07-11 20:42:18,733 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily11 2023-07-11 20:42:18,734 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6cc1f00c76bab58b5f481134121b510 columnFamilyName colfamily11 2023-07-11 20:42:18,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/.tmp/colfamily11/e9efafc092cf4fa0954b40eb52a8a794 2023-07-11 20:42:18,736 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(310): Store=e6cc1f00c76bab58b5f481134121b510/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,736 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:18,736 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:18,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=77 2023-07-11 20:42:18,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=77, state=SUCCESS; OpenRegionProcedure ecacbcb0936c91836cd6ad725ff995f7, server=jenkins-hbase5.apache.org,42009,1689107981238 in 277 msec 2023-07-11 20:42:18,737 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,739 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, openSeqNum=6, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,739 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689108138738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108138738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108138738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108138738"}]},"ts":"1689108138738"} 2023-07-11 20:42:18,739 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily21 2023-07-11 20:42:18,739 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily21 2023-07-11 20:42:18,741 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6cc1f00c76bab58b5f481134121b510 columnFamilyName colfamily21 2023-07-11 20:42:18,742 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(310): Store=e6cc1f00c76bab58b5f481134121b510/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,743 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=79, resume processing ppid=71 2023-07-11 20:42:18,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, ppid=71, state=SUCCESS; OpenRegionProcedure c8518b9630dfef8e8a84f34bffa19948, server=jenkins-hbase5.apache.org,42009,1689107981238 in 314 msec 2023-07-11 20:42:18,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN in 478 msec 2023-07-11 20:42:18,747 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily31 2023-07-11 20:42:18,747 DEBUG [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily31 2023-07-11 20:42:18,749 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6cc1f00c76bab58b5f481134121b510 columnFamilyName colfamily31 2023-07-11 20:42:18,750 INFO [StoreOpener-e6cc1f00c76bab58b5f481134121b510-1] regionserver.HStore(310): Store=e6cc1f00c76bab58b5f481134121b510/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/.tmp/colfamily11/e9efafc092cf4fa0954b40eb52a8a794 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily11/e9efafc092cf4fa0954b40eb52a8a794 2023-07-11 20:42:18,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN in 480 msec 2023-07-11 20:42:18,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004 2023-07-11 20:42:18,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/colfamily11/e9efafc092cf4fa0954b40eb52a8a794, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:18,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ef1ae4440e8f6d786a2521b3b820205c in 95ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:18,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/0000000000000000004 2023-07-11 20:42:18,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004 2023-07-11 20:42:18,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing e6cc1f00c76bab58b5f481134121b510 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:18,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:18,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:18,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ef1ae4440e8f6d786a2521b3b820205c; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65220792, jitterRate=-0.028134465217590332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:18,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ef1ae4440e8f6d786a2521b3b820205c: 2023-07-11 20:42:18,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c., pid=85, masterSystemTime=1689108138617 2023-07-11 20:42:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:18,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:18,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ad8434b03fda3dc4758a9fb74cfdc5d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-11 20:42:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,785 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:18,785 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138784"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108138784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108138784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108138784"}]},"ts":"1689108138784"} 2023-07-11 20:42:18,787 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,788 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11 2023-07-11 20:42:18,788 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11 2023-07-11 20:42:18,788 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ad8434b03fda3dc4758a9fb74cfdc5d columnFamilyName colfamily11 2023-07-11 20:42:18,790 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(310): Store=3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,790 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/.tmp/colfamily11/9b0c302c25174452ab2ae95c5429c46f 2023-07-11 20:42:18,792 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily21 2023-07-11 20:42:18,792 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily21 2023-07-11 20:42:18,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=72 2023-07-11 20:42:18,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=72, state=SUCCESS; OpenRegionProcedure ef1ae4440e8f6d786a2521b3b820205c, server=jenkins-hbase5.apache.org,41489,1689107981112 in 329 msec 2023-07-11 20:42:18,794 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ad8434b03fda3dc4758a9fb74cfdc5d columnFamilyName colfamily21 2023-07-11 20:42:18,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN in 527 msec 2023-07-11 20:42:18,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/.tmp/colfamily11/9b0c302c25174452ab2ae95c5429c46f as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily11/9b0c302c25174452ab2ae95c5429c46f 2023-07-11 20:42:18,803 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(310): Store=3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,803 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,805 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily31 2023-07-11 20:42:18,805 DEBUG [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily31 2023-07-11 20:42:18,805 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ad8434b03fda3dc4758a9fb74cfdc5d columnFamilyName colfamily31 2023-07-11 20:42:18,806 INFO [StoreOpener-3ad8434b03fda3dc4758a9fb74cfdc5d-1] regionserver.HStore(310): Store=3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/colfamily11/9b0c302c25174452ab2ae95c5429c46f, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:18,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for e6cc1f00c76bab58b5f481134121b510 in 48ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:18,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004 2023-07-11 20:42:18,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/0000000000000000004 2023-07-11 20:42:18,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004 2023-07-11 20:42:18,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 3ad8434b03fda3dc4758a9fb74cfdc5d 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:18,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:18,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:18,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:18,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened e6cc1f00c76bab58b5f481134121b510; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73643477, jitterRate=0.09737332165241241}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:18,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for e6cc1f00c76bab58b5f481134121b510: 2023-07-11 20:42:18,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510., pid=84, masterSystemTime=1689108138579 2023-07-11 20:42:18,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:18,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:18,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:18,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d47696c41005c80caeeaa85fe4aebdf, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-11 20:42:18,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,834 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108138834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108138834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108138834"}]},"ts":"1689108138834"} 2023-07-11 20:42:18,836 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,837 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily11 2023-07-11 20:42:18,837 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily11 2023-07-11 20:42:18,837 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d47696c41005c80caeeaa85fe4aebdf columnFamilyName colfamily11 2023-07-11 20:42:18,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=76 2023-07-11 20:42:18,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=76, state=SUCCESS; OpenRegionProcedure e6cc1f00c76bab58b5f481134121b510, server=jenkins-hbase5.apache.org,42009,1689107981238 in 380 msec 2023-07-11 20:42:18,838 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(310): Store=9d47696c41005c80caeeaa85fe4aebdf/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,839 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,840 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily21 2023-07-11 20:42:18,840 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily21 2023-07-11 20:42:18,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN in 571 msec 2023-07-11 20:42:18,841 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d47696c41005c80caeeaa85fe4aebdf columnFamilyName colfamily21 2023-07-11 20:42:18,841 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(310): Store=9d47696c41005c80caeeaa85fe4aebdf/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,841 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,843 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily31 2023-07-11 20:42:18,843 DEBUG [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily31 2023-07-11 20:42:18,843 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d47696c41005c80caeeaa85fe4aebdf columnFamilyName colfamily31 2023-07-11 20:42:18,844 INFO [StoreOpener-9d47696c41005c80caeeaa85fe4aebdf-1] regionserver.HStore(310): Store=9d47696c41005c80caeeaa85fe4aebdf/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004 2023-07-11 20:42:18,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/.tmp/colfamily11/e126636013c34fa590062e8e17780a61 2023-07-11 20:42:18,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004 2023-07-11 20:42:18,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 9d47696c41005c80caeeaa85fe4aebdf 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:18,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/.tmp/colfamily11/e126636013c34fa590062e8e17780a61 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11/e126636013c34fa590062e8e17780a61 2023-07-11 20:42:18,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/colfamily11/e126636013c34fa590062e8e17780a61, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:18,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 3ad8434b03fda3dc4758a9fb74cfdc5d in 54ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:18,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/0000000000000000004 2023-07-11 20:42:18,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:18,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/.tmp/colfamily11/a67fd52dadfa4ff9aca246705dd53352 2023-07-11 20:42:18,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:18,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:18,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 3ad8434b03fda3dc4758a9fb74cfdc5d; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73781915, jitterRate=0.0994362086057663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:18,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 3ad8434b03fda3dc4758a9fb74cfdc5d: 2023-07-11 20:42:18,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d., pid=87, masterSystemTime=1689108138617 2023-07-11 20:42:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:18,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:18,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 771db035f4c5dc0d7b474b119c9c3a12, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2023-07-11 20:42:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:18,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108138888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108138888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108138888"}]},"ts":"1689108138888"} 2023-07-11 20:42:18,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/.tmp/colfamily11/a67fd52dadfa4ff9aca246705dd53352 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily11/a67fd52dadfa4ff9aca246705dd53352 2023-07-11 20:42:18,890 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,891 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily11 2023-07-11 20:42:18,891 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily11 2023-07-11 20:42:18,891 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 771db035f4c5dc0d7b474b119c9c3a12 columnFamilyName colfamily11 2023-07-11 20:42:18,892 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(310): Store=771db035f4c5dc0d7b474b119c9c3a12/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=75 2023-07-11 20:42:18,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=75, state=SUCCESS; OpenRegionProcedure 3ad8434b03fda3dc4758a9fb74cfdc5d, server=jenkins-hbase5.apache.org,41489,1689107981112 in 416 msec 2023-07-11 20:42:18,893 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN in 626 msec 2023-07-11 20:42:18,894 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily21 2023-07-11 20:42:18,895 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily21 2023-07-11 20:42:18,895 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 771db035f4c5dc0d7b474b119c9c3a12 columnFamilyName colfamily21 2023-07-11 20:42:18,897 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(310): Store=771db035f4c5dc0d7b474b119c9c3a12/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,897 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,898 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily31 2023-07-11 20:42:18,898 DEBUG [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily31 2023-07-11 20:42:18,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/colfamily11/a67fd52dadfa4ff9aca246705dd53352, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:18,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 9d47696c41005c80caeeaa85fe4aebdf in 38ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:18,898 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 771db035f4c5dc0d7b474b119c9c3a12 columnFamilyName colfamily31 2023-07-11 20:42:18,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/0000000000000000004 2023-07-11 20:42:18,899 INFO [StoreOpener-771db035f4c5dc0d7b474b119c9c3a12-1] regionserver.HStore(310): Store=771db035f4c5dc0d7b474b119c9c3a12/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:18,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:18,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004 2023-07-11 20:42:18,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:18,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:18,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 9d47696c41005c80caeeaa85fe4aebdf; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73402932, jitterRate=0.09378892183303833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:18,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 9d47696c41005c80caeeaa85fe4aebdf: 2023-07-11 20:42:18,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf., pid=80, masterSystemTime=1689108138579 2023-07-11 20:42:18,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004 2023-07-11 20:42:18,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 771db035f4c5dc0d7b474b119c9c3a12 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:18,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:18,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:18,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:18,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec622bf0b15287b4631102fc291dead5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-11 20:42:18,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:18,912 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=78 updating hbase:meta row=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:18,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,913 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108138912"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108138912"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108138912"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108138912"}]},"ts":"1689108138912"} 2023-07-11 20:42:18,915 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,916 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily11 2023-07-11 20:42:18,916 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily11 2023-07-11 20:42:18,917 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec622bf0b15287b4631102fc291dead5 columnFamilyName colfamily11 2023-07-11 20:42:18,917 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(310): Store=ec622bf0b15287b4631102fc291dead5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,918 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,919 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily21 2023-07-11 20:42:18,919 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily21 2023-07-11 20:42:18,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=78 2023-07-11 20:42:18,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=78, state=SUCCESS; OpenRegionProcedure 9d47696c41005c80caeeaa85fe4aebdf, server=jenkins-hbase5.apache.org,42009,1689107981238 in 482 msec 2023-07-11 20:42:18,923 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec622bf0b15287b4631102fc291dead5 columnFamilyName colfamily21 2023-07-11 20:42:18,924 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(310): Store=ec622bf0b15287b4631102fc291dead5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,924 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN in 656 msec 2023-07-11 20:42:18,925 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily31 2023-07-11 20:42:18,925 DEBUG [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily31 2023-07-11 20:42:18,926 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec622bf0b15287b4631102fc291dead5 columnFamilyName colfamily31 2023-07-11 20:42:18,926 INFO [StoreOpener-ec622bf0b15287b4631102fc291dead5-1] regionserver.HStore(310): Store=ec622bf0b15287b4631102fc291dead5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:18,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:18,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004 2023-07-11 20:42:18,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004 2023-07-11 20:42:18,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing ec622bf0b15287b4631102fc291dead5 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:18,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/.tmp/colfamily11/3ac32a7a6d9b4f84a731a0c28fb439d6 2023-07-11 20:42:18,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/.tmp/colfamily11/3ac32a7a6d9b4f84a731a0c28fb439d6 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily11/3ac32a7a6d9b4f84a731a0c28fb439d6 2023-07-11 20:42:18,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/colfamily11/3ac32a7a6d9b4f84a731a0c28fb439d6, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:18,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 771db035f4c5dc0d7b474b119c9c3a12 in 86ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:18,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/0000000000000000004 2023-07-11 20:42:19,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:19,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:19,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/.tmp/colfamily11/e0fd580836ee4a959f3f29ff718ddd3a 2023-07-11 20:42:19,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:19,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 771db035f4c5dc0d7b474b119c9c3a12; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69506092, jitterRate=0.03572148084640503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:19,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 771db035f4c5dc0d7b474b119c9c3a12: 2023-07-11 20:42:19,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12., pid=88, masterSystemTime=1689108138617 2023-07-11 20:42:19,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:19,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:19,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:19,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b0ceba1adb699bcddcac5c4ff683a7d5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-11 20:42:19,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:19,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108139014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108139014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108139014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108139014"}]},"ts":"1689108139014"} 2023-07-11 20:42:19,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:19,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/.tmp/colfamily11/e0fd580836ee4a959f3f29ff718ddd3a as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily11/e0fd580836ee4a959f3f29ff718ddd3a 2023-07-11 20:42:19,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,019 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,021 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11 2023-07-11 20:42:19,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=70 2023-07-11 20:42:19,021 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11 2023-07-11 20:42:19,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=70, state=SUCCESS; OpenRegionProcedure 771db035f4c5dc0d7b474b119c9c3a12, server=jenkins-hbase5.apache.org,41489,1689107981112 in 541 msec 2023-07-11 20:42:19,022 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0ceba1adb699bcddcac5c4ff683a7d5 columnFamilyName colfamily11 2023-07-11 20:42:19,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN in 755 msec 2023-07-11 20:42:19,023 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(310): Store=b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:19,023 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/colfamily11/e0fd580836ee4a959f3f29ff718ddd3a, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:19,024 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily21 2023-07-11 20:42:19,024 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily21 2023-07-11 20:42:19,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ec622bf0b15287b4631102fc291dead5 in 87ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:19,025 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0ceba1adb699bcddcac5c4ff683a7d5 columnFamilyName colfamily21 2023-07-11 20:42:19,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/0000000000000000004 2023-07-11 20:42:19,026 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(310): Store=b0ceba1adb699bcddcac5c4ff683a7d5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:19,026 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,027 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily31 2023-07-11 20:42:19,027 DEBUG [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily31 2023-07-11 20:42:19,027 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0ceba1adb699bcddcac5c4ff683a7d5 columnFamilyName colfamily31 2023-07-11 20:42:19,028 INFO [StoreOpener-b0ceba1adb699bcddcac5c4ff683a7d5-1] regionserver.HStore(310): Store=b0ceba1adb699bcddcac5c4ff683a7d5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:19,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:19,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004 2023-07-11 20:42:19,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:19,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ec622bf0b15287b4631102fc291dead5; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73512713, jitterRate=0.09542478621006012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:19,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ec622bf0b15287b4631102fc291dead5: 2023-07-11 20:42:19,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5., pid=81, masterSystemTime=1689108138579 2023-07-11 20:42:19,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:19,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:19,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:19,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8703bfd69cad775e76710af34863a09, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-11 20:42:19,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,038 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:42:19,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,038 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108139038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108139038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108139038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108139038"}]},"ts":"1689108139038"} 2023-07-11 20:42:19,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004 2023-07-11 20:42:19,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing b0ceba1adb699bcddcac5c4ff683a7d5 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:19,040 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,041 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily11 2023-07-11 20:42:19,041 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily11 2023-07-11 20:42:19,042 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8703bfd69cad775e76710af34863a09 columnFamilyName colfamily11 2023-07-11 20:42:19,042 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(310): Store=f8703bfd69cad775e76710af34863a09/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:19,043 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=69 2023-07-11 20:42:19,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=69, state=SUCCESS; OpenRegionProcedure ec622bf0b15287b4631102fc291dead5, server=jenkins-hbase5.apache.org,42009,1689107981238 in 602 msec 2023-07-11 20:42:19,044 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily21 2023-07-11 20:42:19,044 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily21 2023-07-11 20:42:19,044 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8703bfd69cad775e76710af34863a09 columnFamilyName colfamily21 2023-07-11 20:42:19,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN in 777 msec 2023-07-11 20:42:19,045 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(310): Store=f8703bfd69cad775e76710af34863a09/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:19,045 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,046 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily31 2023-07-11 20:42:19,046 DEBUG [StoreOpener-f8703bfd69cad775e76710af34863a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily31 2023-07-11 20:42:19,047 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8703bfd69cad775e76710af34863a09 columnFamilyName colfamily31 2023-07-11 20:42:19,048 INFO [StoreOpener-f8703bfd69cad775e76710af34863a09-1] regionserver.HStore(310): Store=f8703bfd69cad775e76710af34863a09/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:42:19,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004 2023-07-11 20:42:19,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004 2023-07-11 20:42:19,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing f8703bfd69cad775e76710af34863a09 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:19,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/.tmp/colfamily11/b82c371a454c4149b6e69cab609f8196 2023-07-11 20:42:19,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/.tmp/colfamily11/b82c371a454c4149b6e69cab609f8196 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11/b82c371a454c4149b6e69cab609f8196 2023-07-11 20:42:19,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/colfamily11/b82c371a454c4149b6e69cab609f8196, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:19,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for b0ceba1adb699bcddcac5c4ff683a7d5 in 41ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:19,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/0000000000000000004 2023-07-11 20:42:19,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:19,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:19,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:19,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened b0ceba1adb699bcddcac5c4ff683a7d5; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65796299, jitterRate=-0.01955874264240265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:19,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for b0ceba1adb699bcddcac5c4ff683a7d5: 2023-07-11 20:42:19,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/.tmp/colfamily11/e5ac7a80a7154d379625cd830e77c290 2023-07-11 20:42:19,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5., pid=86, masterSystemTime=1689108138617 2023-07-11 20:42:19,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:19,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:19,101 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:19,101 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108139101"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108139101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108139101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108139101"}]},"ts":"1689108139101"} 2023-07-11 20:42:19,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=73 2023-07-11 20:42:19,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=73, state=SUCCESS; OpenRegionProcedure b0ceba1adb699bcddcac5c4ff683a7d5, server=jenkins-hbase5.apache.org,41489,1689107981112 in 633 msec 2023-07-11 20:42:19,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN in 838 msec 2023-07-11 20:42:19,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/.tmp/colfamily11/e5ac7a80a7154d379625cd830e77c290 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily11/e5ac7a80a7154d379625cd830e77c290 2023-07-11 20:42:19,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/colfamily11/e5ac7a80a7154d379625cd830e77c290, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 20:42:19,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for f8703bfd69cad775e76710af34863a09 in 62ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 20:42:19,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/0000000000000000004 2023-07-11 20:42:19,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:42:19,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:19,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 20:42:19,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened f8703bfd69cad775e76710af34863a09; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71935988, jitterRate=0.07192975282669067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:42:19,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for f8703bfd69cad775e76710af34863a09: 2023-07-11 20:42:19,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09., pid=82, masterSystemTime=1689108138579 2023-07-11 20:42:19,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:19,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:19,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=f8703bfd69cad775e76710af34863a09, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689108139130"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689108139130"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689108139130"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689108139130"}]},"ts":"1689108139130"} 2023-07-11 20:42:19,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=74 2023-07-11 20:42:19,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=74, state=SUCCESS; OpenRegionProcedure f8703bfd69cad775e76710af34863a09, server=jenkins-hbase5.apache.org,42009,1689107981238 in 688 msec 2023-07-11 20:42:19,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=62 2023-07-11 20:42:19,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN in 867 msec 2023-07-11 20:42:19,136 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase5.apache.org,44935,1689107981188 after splitting done 2023-07-11 20:42:19,136 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase5.apache.org,44935,1689107981188 from processing; numProcessing=0 2023-07-11 20:42:19,136 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 20:42:19,136 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:19,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:42:19,136 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 20:42:19,266 INFO [Listener at localhost/45761] procedure.MasterProcedureTestingUtility(454): Restart 8 exec state=pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:19,266 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 20:42:19,266 INFO [Listener at localhost/45761] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:42:19,266 INFO [Listener at localhost/45761] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:42:19,266 ERROR [Listener at localhost/45761] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:42:19,266 INFO [Listener at localhost/45761] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 20:42:19,266 INFO [Listener at localhost/45761] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 20:42:19,266 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 20:42:19,267 INFO [Listener at localhost/45761] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:42:19,267 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 20:42:19,268 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25, 26, 27] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=69, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[37, 42, 73] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=81, ppid=69, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[43, 72] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=70, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[36, 56, 71] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=88, ppid=70, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[57, 70] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=71, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[28, 38, 60] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=79, ppid=71, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[39, 59] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=72, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[35, 50, 63] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=85, ppid=72, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[51, 62] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=73, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[34, 52, 75] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=86, ppid=73, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[53, 74] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=74, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[33, 44, 77] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=82, ppid=74, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[45, 76] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=75, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[32, 54, 67] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=87, ppid=75, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[55, 66] 2023-07-11 20:42:19,269 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=76, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[31, 48, 65] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=84, ppid=76, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[49, 64] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=77, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[30, 46, 61] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=83, ppid=77, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[47, 58] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=78, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[29, 40, 69] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=80, ppid=78, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[41, 68] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 20:42:19,270 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 20:42:19,271 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 20:42:19,271 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 20:42:19,271 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:42:19,271 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN 2023-07-11 20:42:19,274 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=79, ppid=71, state=SUCCESS; OpenRegionProcedure c8518b9630dfef8e8a84f34bffa19948, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=80, ppid=78, state=SUCCESS; OpenRegionProcedure 9d47696c41005c80caeeaa85fe4aebdf, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=81, ppid=69, state=SUCCESS; OpenRegionProcedure ec622bf0b15287b4631102fc291dead5, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,275 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=82, ppid=74, state=SUCCESS; OpenRegionProcedure f8703bfd69cad775e76710af34863a09, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=83, ppid=77, state=SUCCESS; OpenRegionProcedure ecacbcb0936c91836cd6ad725ff995f7, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=84, ppid=76, state=SUCCESS; OpenRegionProcedure e6cc1f00c76bab58b5f481134121b510, server=jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=85, ppid=72, state=SUCCESS; OpenRegionProcedure ef1ae4440e8f6d786a2521b3b820205c, server=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=86, ppid=73, state=SUCCESS; OpenRegionProcedure b0ceba1adb699bcddcac5c4ff683a7d5, server=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=87, ppid=75, state=SUCCESS; OpenRegionProcedure 3ad8434b03fda3dc4758a9fb74cfdc5d, server=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.ProcedureExecutor(468): Loading pid=88, ppid=70, state=SUCCESS; OpenRegionProcedure 771db035f4c5dc0d7b474b119c9c3a12, server=jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.meta.1689107983612.meta, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase5.apache.org%2C44935%2C1689107981188.1689107983396, worker=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec622bf0b15287b4631102fc291dead5, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=771db035f4c5dc0d7b474b119c9c3a12, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,278 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c8518b9630dfef8e8a84f34bffa19948, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ef1ae4440e8f6d786a2521b3b820205c, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b0ceba1adb699bcddcac5c4ff683a7d5, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f8703bfd69cad775e76710af34863a09, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3ad8434b03fda3dc4758a9fb74cfdc5d, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6cc1f00c76bab58b5f481134121b510, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ecacbcb0936c91836cd6ad725ff995f7, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d47696c41005c80caeeaa85fe4aebdf, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=79, ppid=71, state=SUCCESS; OpenRegionProcedure c8518b9630dfef8e8a84f34bffa19948, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=80, ppid=78, state=SUCCESS; OpenRegionProcedure 9d47696c41005c80caeeaa85fe4aebdf, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=81, ppid=69, state=SUCCESS; OpenRegionProcedure ec622bf0b15287b4631102fc291dead5, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=82, ppid=74, state=SUCCESS; OpenRegionProcedure f8703bfd69cad775e76710af34863a09, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=83, ppid=77, state=SUCCESS; OpenRegionProcedure ecacbcb0936c91836cd6ad725ff995f7, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=84, ppid=76, state=SUCCESS; OpenRegionProcedure e6cc1f00c76bab58b5f481134121b510, server=jenkins-hbase5.apache.org,42009,1689107981238 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=85, ppid=72, state=SUCCESS; OpenRegionProcedure ef1ae4440e8f6d786a2521b3b820205c, server=jenkins-hbase5.apache.org,41489,1689107981112 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=86, ppid=73, state=SUCCESS; OpenRegionProcedure b0ceba1adb699bcddcac5c4ff683a7d5, server=jenkins-hbase5.apache.org,41489,1689107981112 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=87, ppid=75, state=SUCCESS; OpenRegionProcedure 3ad8434b03fda3dc4758a9fb74cfdc5d, server=jenkins-hbase5.apache.org,41489,1689107981112 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,279 DEBUG [Listener at localhost/45761] procedure2.Procedure(946): pid=88, ppid=70, state=SUCCESS; OpenRegionProcedure 771db035f4c5dc0d7b474b119c9c3a12, server=jenkins-hbase5.apache.org,41489,1689107981112 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 20:42:19,280 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 12 msec 2023-07-11 20:42:19,281 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 20:42:19,281 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase5.apache.org,42009,1689107981238, table=hbase:meta, region=1588230740 2023-07-11 20:42:19,282 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689108169282 2023-07-11 20:42:19,284 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase5.apache.org,44935,1689107981188; numProcessing=1 2023-07-11 20:42:19,284 DEBUG [Listener at localhost/45761] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:42:19,293 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c8518b9630dfef8e8a84f34bffa19948, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=6 2023-07-11 20:42:19,293 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=032d0495ec0964438e1a1750441fa9f9, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,293 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=e6cc1f00c76bab58b5f481134121b510, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=5 2023-07-11 20:42:19,293 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=2ca9cb0f701c87260f2be41ccb924558, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,294 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1f1f55e7b9bb4f716044688e8cde5170, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,294 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=126966e5d395a2142294de9a3be86ebf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,294 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=771db035f4c5dc0d7b474b119c9c3a12, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=5 2023-07-11 20:42:19,294 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=4e500486342518ff5692418f30fc7f83, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,294 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=271710c1c9bb963a3440ef4a722e1452, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,295 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ecacbcb0936c91836cd6ad725ff995f7, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=5 2023-07-11 20:42:19,295 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=a66eca7e7de9f874fbf8a3b37791f8be, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,295 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=3ad8434b03fda3dc4758a9fb74cfdc5d, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=5 2023-07-11 20:42:19,295 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=fe2b95730f173e86f1c38a731479321f, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,295 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=252836bab05fe1e164f33265af5a41a2, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,295 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=f8703bfd69cad775e76710af34863a09, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=5 2023-07-11 20:42:19,296 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=34c7c2230412431453d1e48ace10e600, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,296 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=b0ceba1adb699bcddcac5c4ff683a7d5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=5 2023-07-11 20:42:19,296 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9996238a94686c4a78ed12dd9da6fbe6, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,296 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=950bc72614c9a8a43882ca9374cd68b1, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,296 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=1c6c57adadf49aca13384cc30abb8442, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,297 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ec622bf0b15287b4631102fc291dead5, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=5 2023-07-11 20:42:19,297 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=ef1ae4440e8f6d786a2521b3b820205c, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=5 2023-07-11 20:42:19,297 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=8e8a887c1dfba3387c203eaa29970d81, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,297 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=bb68c30b67501f47ae63c14ce057756a, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,297 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=9d47696c41005c80caeeaa85fe4aebdf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=5 2023-07-11 20:42:19,298 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=c3f1f11bb87dbde31c4a80a24b4804cf, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,41489,1689107981112, regionLocation=jenkins-hbase5.apache.org,41489,1689107981112, openSeqNum=2 2023-07-11 20:42:19,298 DEBUG [Listener at localhost/45761] assignment.RegionStateStore(147): Load hbase:meta entry region=80ec0d0a545f169fdf6bee237db4b021, regionState=OPEN, lastHost=jenkins-hbase5.apache.org,42009,1689107981238, regionLocation=jenkins-hbase5.apache.org,42009,1689107981238, openSeqNum=2 2023-07-11 20:42:19,298 INFO [Listener at localhost/45761] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 20:42:19,298 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689108199298 2023-07-11 20:42:19,298 INFO [Listener at localhost/45761] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689108259298 2023-07-11 20:42:19,298 INFO [Listener at localhost/45761] assignment.AssignmentManager(1536): Joined the cluster in 14 msec 2023-07-11 20:42:19,298 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase5.apache.org,44935,1689107981188 after splitting done 2023-07-11 20:42:19,298 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase5.apache.org,44935,1689107981188 from processing; numProcessing=0 2023-07-11 20:42:19,298 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 20:42:19,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; ServerCrashProcedure jenkins-hbase5.apache.org,44935,1689107981188, splitWal=true, meta=true in 2 mins, 28.932 sec 2023-07-11 20:42:19,553 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 20:42:19,563 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:33726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:42:19,568 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 20:42:19,572 WARN [RPCClient-NioEventLoopGroup-6-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase5.apache.org/172.31.10.131:44935 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:42:19,575 DEBUG [RPCClient-NioEventLoopGroup-6-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase5.apache.org/172.31.10.131:44935 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase5.apache.org/172.31.10.131:44935 2023-07-11 20:42:19,676 DEBUG [hconnection-0x13b46851-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:19,783 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:36902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:42:19,800 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 20:42:19,804 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 20:42:19,810 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 20:42:19,815 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 20:42:19,815 DEBUG [hconnection-0x13b46851-shared-pool-12] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:19,931 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 20:42:19,939 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 20:42:19,944 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 20:42:19,944 DEBUG [hconnection-0x13b46851-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:20,058 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 20:42:20,062 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 20:42:20,063 DEBUG [hconnection-0x13b46851-shared-pool-11] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:20,178 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 20:42:20,182 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 20:42:20,187 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 20:42:20,187 DEBUG [hconnection-0x13b46851-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:20,312 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 20:42:20,317 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 20:42:20,318 DEBUG [hconnection-0x13b46851-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:20,430 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 20:42:20,435 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 20:42:20,438 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 20:42:20,441 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 20:42:20,441 DEBUG [hconnection-0x13b46851-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:20,562 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 20:42:20,562 DEBUG [hconnection-0x13b46851-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:20,673 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 20:42:20,679 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 20:42:20,683 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 20:42:20,683 DEBUG [hconnection-0x13b46851-shared-pool-12] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase5.apache.org/172.31.10.131:44935 this server is in the failed servers list 2023-07-11 20:42:20,795 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 20:42:20,798 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 20:42:20,803 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 20:42:20,806 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 20:42:20,809 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 20:42:20,813 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 20:42:20,816 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 20:42:20,819 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 20:42:20,823 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 20:42:20,826 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 20:42:20,831 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 20:42:20,835 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 20:42:20,838 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 20:42:20,842 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 20:42:20,847 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 20:42:20,853 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 20:42:20,856 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 20:42:20,859 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 20:42:20,862 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 20:42:20,865 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 20:42:20,868 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 20:42:20,872 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 20:42:20,875 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 20:42:20,878 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 20:42:20,880 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 20:42:20,883 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 20:42:20,886 DEBUG [Listener at localhost/45761] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 20:42:20,893 WARN [Listener at localhost/45761] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-11 20:42:20,893 INFO [Listener at localhost/45761] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 20:42:20,893 INFO [Listener at localhost/45761] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 20:42:20,894 DEBUG [Listener at localhost/45761] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5eb31403 to 127.0.0.1:57657 2023-07-11 20:42:20,894 DEBUG [Listener at localhost/45761] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:42:20,896 DEBUG [Listener at localhost/45761] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 20:42:20,896 DEBUG [Listener at localhost/45761] util.JVMClusterUtil(257): Found active master hash=670015673, stopped=false 2023-07-11 20:42:20,897 INFO [Listener at localhost/45761] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:42:20,902 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:42:20,902 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:42:20,902 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:42:20,902 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:42:20,902 INFO [Listener at localhost/45761] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:42:20,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:42:20,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:42:20,909 DEBUG [Listener at localhost/45761] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35fd0e3f to 127.0.0.1:57657 2023-07-11 20:42:20,909 DEBUG [Listener at localhost/45761] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:42:20,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:42:20,910 INFO [Listener at localhost/45761] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,41489,1689107981112' ***** 2023-07-11 20:42:20,910 INFO [Listener at localhost/45761] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:42:20,910 INFO [Listener at localhost/45761] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,42009,1689107981238' ***** 2023-07-11 20:42:20,910 INFO [Listener at localhost/45761] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:42:20,911 INFO [RS:2;jenkins-hbase5:42009] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:42:20,911 INFO [RS:2;jenkins-hbase5:42009] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:42:20,911 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:42:20,911 INFO [RS:2;jenkins-hbase5:42009] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:42:20,912 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:20,915 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for ecacbcb0936c91836cd6ad725ff995f7 2023-07-11 20:42:20,915 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 9996238a94686c4a78ed12dd9da6fbe6 2023-07-11 20:42:20,915 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 1c6c57adadf49aca13384cc30abb8442 2023-07-11 20:42:20,917 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for c8518b9630dfef8e8a84f34bffa19948 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 9d47696c41005c80caeeaa85fe4aebdf 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 80ec0d0a545f169fdf6bee237db4b021 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 2ca9cb0f701c87260f2be41ccb924558 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for e6cc1f00c76bab58b5f481134121b510 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 252836bab05fe1e164f33265af5a41a2 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 271710c1c9bb963a3440ef4a722e1452 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 126966e5d395a2142294de9a3be86ebf 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:42:20,918 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:20,918 DEBUG [RS:2;jenkins-hbase5:42009] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x237871f7 to 127.0.0.1:57657 2023-07-11 20:42:20,918 DEBUG [RS:2;jenkins-hbase5:42009] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:42:20,918 INFO [RS:0;jenkins-hbase5:41489] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:42:20,919 INFO [RS:0;jenkins-hbase5:41489] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:42:20,919 INFO [RS:0;jenkins-hbase5:41489] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:42:20,919 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 4e500486342518ff5692418f30fc7f83 2023-07-11 20:42:20,920 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:42:20,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing f8703bfd69cad775e76710af34863a09, disabling compactions & flushes 2023-07-11 20:42:20,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:20,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:20,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. after waiting 0 ms 2023-07-11 20:42:20,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:20,927 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 8e8a887c1dfba3387c203eaa29970d81 2023-07-11 20:42:20,927 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 032d0495ec0964438e1a1750441fa9f9 2023-07-11 20:42:20,927 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 3ad8434b03fda3dc4758a9fb74cfdc5d 2023-07-11 20:42:20,927 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for b0ceba1adb699bcddcac5c4ff683a7d5 2023-07-11 20:42:20,927 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 34c7c2230412431453d1e48ace10e600 2023-07-11 20:42:20,927 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 771db035f4c5dc0d7b474b119c9c3a12 2023-07-11 20:42:20,927 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for c3f1f11bb87dbde31c4a80a24b4804cf 2023-07-11 20:42:20,928 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 1f1f55e7b9bb4f716044688e8cde5170 2023-07-11 20:42:20,928 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for 950bc72614c9a8a43882ca9374cd68b1 2023-07-11 20:42:20,928 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:20,928 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(3305): Received CLOSE for ef1ae4440e8f6d786a2521b3b820205c 2023-07-11 20:42:20,928 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:20,928 DEBUG [RS:0;jenkins-hbase5:41489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x637bf8c1 to 127.0.0.1:57657 2023-07-11 20:42:20,928 DEBUG [RS:0;jenkins-hbase5:41489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:42:20,939 INFO [RS:2;jenkins-hbase5:42009] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:42:20,939 INFO [RS:2;jenkins-hbase5:42009] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:42:20,939 INFO [RS:2;jenkins-hbase5:42009] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:42:20,939 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 20:42:20,955 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1474): Waiting on 12 regions to close 2023-07-11 20:42:20,957 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1504): Waiting on 032d0495ec0964438e1a1750441fa9f9, 1f1f55e7b9bb4f716044688e8cde5170, 34c7c2230412431453d1e48ace10e600, 3ad8434b03fda3dc4758a9fb74cfdc5d, 4e500486342518ff5692418f30fc7f83, 771db035f4c5dc0d7b474b119c9c3a12, 8e8a887c1dfba3387c203eaa29970d81, 950bc72614c9a8a43882ca9374cd68b1, b0ceba1adb699bcddcac5c4ff683a7d5, c3f1f11bb87dbde31c4a80a24b4804cf, ef1ae4440e8f6d786a2521b3b820205c, fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:20,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 4e500486342518ff5692418f30fc7f83, disabling compactions & flushes 2023-07-11 20:42:20,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:42:20,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:42:20,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. after waiting 0 ms 2023-07-11 20:42:20,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:42:20,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 4e500486342518ff5692418f30fc7f83 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:20,961 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1474): Waiting on 16 regions to close 2023-07-11 20:42:20,962 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1504): Waiting on 126966e5d395a2142294de9a3be86ebf, 1588230740, 1c6c57adadf49aca13384cc30abb8442, 252836bab05fe1e164f33265af5a41a2, 271710c1c9bb963a3440ef4a722e1452, 2ca9cb0f701c87260f2be41ccb924558, 80ec0d0a545f169fdf6bee237db4b021, 9996238a94686c4a78ed12dd9da6fbe6, 9d47696c41005c80caeeaa85fe4aebdf, a66eca7e7de9f874fbf8a3b37791f8be, bb68c30b67501f47ae63c14ce057756a, c8518b9630dfef8e8a84f34bffa19948, e6cc1f00c76bab58b5f481134121b510, ec622bf0b15287b4631102fc291dead5, ecacbcb0936c91836cd6ad725ff995f7, f8703bfd69cad775e76710af34863a09 2023-07-11 20:42:20,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 20:42:20,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 20:42:20,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 20:42:20,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 20:42:20,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 20:42:20,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.56 KB heapSize=21.12 KB 2023-07-11 20:42:20,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f8703bfd69cad775e76710af34863a09/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:20,990 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:42:20,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:20,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for f8703bfd69cad775e76710af34863a09: 2023-07-11 20:42:20,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689107984954.f8703bfd69cad775e76710af34863a09. 2023-07-11 20:42:21,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ecacbcb0936c91836cd6ad725ff995f7, disabling compactions & flushes 2023-07-11 20:42:21,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:21,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:21,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. after waiting 0 ms 2023-07-11 20:42:21,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:21,007 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:42:21,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ecacbcb0936c91836cd6ad725ff995f7/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:21,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:21,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ecacbcb0936c91836cd6ad725ff995f7: 2023-07-11 20:42:21,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689107984954.ecacbcb0936c91836cd6ad725ff995f7. 2023-07-11 20:42:21,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 9996238a94686c4a78ed12dd9da6fbe6, disabling compactions & flushes 2023-07-11 20:42:21,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:42:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:42:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. after waiting 0 ms 2023-07-11 20:42:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:42:21,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 9996238a94686c4a78ed12dd9da6fbe6 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=14.56 KB at sequenceid=86 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/.tmp/info/a46baac68f724ce5803076e5a7d1d91e 2023-07-11 20:42:21,158 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1504): Waiting on 032d0495ec0964438e1a1750441fa9f9, 1f1f55e7b9bb4f716044688e8cde5170, 34c7c2230412431453d1e48ace10e600, 3ad8434b03fda3dc4758a9fb74cfdc5d, 4e500486342518ff5692418f30fc7f83, 771db035f4c5dc0d7b474b119c9c3a12, 8e8a887c1dfba3387c203eaa29970d81, 950bc72614c9a8a43882ca9374cd68b1, b0ceba1adb699bcddcac5c4ff683a7d5, c3f1f11bb87dbde31c4a80a24b4804cf, ef1ae4440e8f6d786a2521b3b820205c, fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:21,162 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1504): Waiting on 126966e5d395a2142294de9a3be86ebf, 1588230740, 1c6c57adadf49aca13384cc30abb8442, 252836bab05fe1e164f33265af5a41a2, 271710c1c9bb963a3440ef4a722e1452, 2ca9cb0f701c87260f2be41ccb924558, 80ec0d0a545f169fdf6bee237db4b021, 9996238a94686c4a78ed12dd9da6fbe6, 9d47696c41005c80caeeaa85fe4aebdf, a66eca7e7de9f874fbf8a3b37791f8be, bb68c30b67501f47ae63c14ce057756a, c8518b9630dfef8e8a84f34bffa19948, e6cc1f00c76bab58b5f481134121b510, ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:21,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/.tmp/info/a46baac68f724ce5803076e5a7d1d91e as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info/a46baac68f724ce5803076e5a7d1d91e 2023-07-11 20:42:21,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/info/a46baac68f724ce5803076e5a7d1d91e, entries=80, sequenceid=86, filesize=19.6 K 2023-07-11 20:42:21,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.56 KB/14908, heapSize ~20.60 KB/21096, currentSize=0 B/0 for 1588230740 in 260ms, sequenceid=86, compaction requested=false 2023-07-11 20:42:21,227 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 20:42:21,227 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 20:42:21,230 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 20:42:21,230 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 20:42:21,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/.tmp/colfamily11/5fde669fdcfd4c5c9e378a894523f219 2023-07-11 20:42:21,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/.tmp/colfamily11/5fde669fdcfd4c5c9e378a894523f219 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily11/5fde669fdcfd4c5c9e378a894523f219 2023-07-11 20:42:21,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/colfamily11/5fde669fdcfd4c5c9e378a894523f219, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 9996238a94686c4a78ed12dd9da6fbe6 in 212ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,322 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/meta/1588230740/recovered.edits/89.seqid, newMaxSeqId=89, maxSeqId=63 2023-07-11 20:42:21,322 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 20:42:21,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 20:42:21,324 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 20:42:21,324 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 20:42:21,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9996238a94686c4a78ed12dd9da6fbe6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:42:21,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 9996238a94686c4a78ed12dd9da6fbe6: 2023-07-11 20:42:21,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689107984954.9996238a94686c4a78ed12dd9da6fbe6. 2023-07-11 20:42:21,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1c6c57adadf49aca13384cc30abb8442, disabling compactions & flushes 2023-07-11 20:42:21,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:42:21,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:42:21,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. after waiting 0 ms 2023-07-11 20:42:21,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:42:21,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1c6c57adadf49aca13384cc30abb8442 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,358 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1504): Waiting on 032d0495ec0964438e1a1750441fa9f9, 1f1f55e7b9bb4f716044688e8cde5170, 34c7c2230412431453d1e48ace10e600, 3ad8434b03fda3dc4758a9fb74cfdc5d, 4e500486342518ff5692418f30fc7f83, 771db035f4c5dc0d7b474b119c9c3a12, 8e8a887c1dfba3387c203eaa29970d81, 950bc72614c9a8a43882ca9374cd68b1, b0ceba1adb699bcddcac5c4ff683a7d5, c3f1f11bb87dbde31c4a80a24b4804cf, ef1ae4440e8f6d786a2521b3b820205c, fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:21,362 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1504): Waiting on 126966e5d395a2142294de9a3be86ebf, 1c6c57adadf49aca13384cc30abb8442, 252836bab05fe1e164f33265af5a41a2, 271710c1c9bb963a3440ef4a722e1452, 2ca9cb0f701c87260f2be41ccb924558, 80ec0d0a545f169fdf6bee237db4b021, 9d47696c41005c80caeeaa85fe4aebdf, a66eca7e7de9f874fbf8a3b37791f8be, bb68c30b67501f47ae63c14ce057756a, c8518b9630dfef8e8a84f34bffa19948, e6cc1f00c76bab58b5f481134121b510, ec622bf0b15287b4631102fc291dead5 2023-07-11 20:42:21,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/.tmp/colfamily11/6bab42fe8f6b4e6aaf42bc0e9ec9c9bf 2023-07-11 20:42:21,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/.tmp/colfamily11/6bab42fe8f6b4e6aaf42bc0e9ec9c9bf as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily11/6bab42fe8f6b4e6aaf42bc0e9ec9c9bf 2023-07-11 20:42:21,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/colfamily11/6bab42fe8f6b4e6aaf42bc0e9ec9c9bf, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 1c6c57adadf49aca13384cc30abb8442 in 55ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1c6c57adadf49aca13384cc30abb8442/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:42:21,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1c6c57adadf49aca13384cc30abb8442: 2023-07-11 20:42:21,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689107984954.1c6c57adadf49aca13384cc30abb8442. 2023-07-11 20:42:21,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c8518b9630dfef8e8a84f34bffa19948, disabling compactions & flushes 2023-07-11 20:42:21,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. after waiting 0 ms 2023-07-11 20:42:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:21,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/hbase/namespace/c8518b9630dfef8e8a84f34bffa19948/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=5 2023-07-11 20:42:21,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:21,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c8518b9630dfef8e8a84f34bffa19948: 2023-07-11 20:42:21,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689107983943.c8518b9630dfef8e8a84f34bffa19948. 2023-07-11 20:42:21,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 9d47696c41005c80caeeaa85fe4aebdf, disabling compactions & flushes 2023-07-11 20:42:21,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:21,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:21,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. after waiting 0 ms 2023-07-11 20:42:21,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:21,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d47696c41005c80caeeaa85fe4aebdf/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:21,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:21,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 9d47696c41005c80caeeaa85fe4aebdf: 2023-07-11 20:42:21,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689107984954.9d47696c41005c80caeeaa85fe4aebdf. 2023-07-11 20:42:21,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 80ec0d0a545f169fdf6bee237db4b021, disabling compactions & flushes 2023-07-11 20:42:21,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:42:21,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:42:21,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. after waiting 0 ms 2023-07-11 20:42:21,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:42:21,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 80ec0d0a545f169fdf6bee237db4b021 3/3 column families, dataSize=48 B heapSize=888 B 2023-07-11 20:42:21,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48 B at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/.tmp/colfamily11/0a7009d0660342168b2325e518d4bebd 2023-07-11 20:42:21,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/.tmp/colfamily11/0a7009d0660342168b2325e518d4bebd as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily11/0a7009d0660342168b2325e518d4bebd 2023-07-11 20:42:21,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/colfamily11/0a7009d0660342168b2325e518d4bebd, entries=1, sequenceid=5, filesize=4.6 K 2023-07-11 20:42:21,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 80ec0d0a545f169fdf6bee237db4b021 in 48ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/80ec0d0a545f169fdf6bee237db4b021/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:42:21,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 80ec0d0a545f169fdf6bee237db4b021: 2023-07-11 20:42:21,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689107984954.80ec0d0a545f169fdf6bee237db4b021. 2023-07-11 20:42:21,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 2ca9cb0f701c87260f2be41ccb924558, disabling compactions & flushes 2023-07-11 20:42:21,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:42:21,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:42:21,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. after waiting 0 ms 2023-07-11 20:42:21,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:42:21,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 2ca9cb0f701c87260f2be41ccb924558 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/.tmp/colfamily11/4b178b9bad4d4319a961dad037c580a7 2023-07-11 20:42:21,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/.tmp/colfamily11/4b178b9bad4d4319a961dad037c580a7 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily11/4b178b9bad4d4319a961dad037c580a7 2023-07-11 20:42:21,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/colfamily11/4b178b9bad4d4319a961dad037c580a7, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 2ca9cb0f701c87260f2be41ccb924558 in 45ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2ca9cb0f701c87260f2be41ccb924558/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:42:21,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 2ca9cb0f701c87260f2be41ccb924558: 2023-07-11 20:42:21,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689107984954.2ca9cb0f701c87260f2be41ccb924558. 2023-07-11 20:42:21,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ec622bf0b15287b4631102fc291dead5, disabling compactions & flushes 2023-07-11 20:42:21,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:21,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:21,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. after waiting 0 ms 2023-07-11 20:42:21,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:21,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec622bf0b15287b4631102fc291dead5/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:21,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:21,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ec622bf0b15287b4631102fc291dead5: 2023-07-11 20:42:21,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689107984954.ec622bf0b15287b4631102fc291dead5. 2023-07-11 20:42:21,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing e6cc1f00c76bab58b5f481134121b510, disabling compactions & flushes 2023-07-11 20:42:21,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:21,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:21,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. after waiting 0 ms 2023-07-11 20:42:21,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:21,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6cc1f00c76bab58b5f481134121b510/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:21,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:21,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for e6cc1f00c76bab58b5f481134121b510: 2023-07-11 20:42:21,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689107984954.e6cc1f00c76bab58b5f481134121b510. 2023-07-11 20:42:21,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 252836bab05fe1e164f33265af5a41a2, disabling compactions & flushes 2023-07-11 20:42:21,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:42:21,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:42:21,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. after waiting 0 ms 2023-07-11 20:42:21,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:42:21,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 252836bab05fe1e164f33265af5a41a2 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/.tmp/colfamily11/fa504b94aca643fba49152e57992f03d 2023-07-11 20:42:21,558 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1504): Waiting on 032d0495ec0964438e1a1750441fa9f9, 1f1f55e7b9bb4f716044688e8cde5170, 34c7c2230412431453d1e48ace10e600, 3ad8434b03fda3dc4758a9fb74cfdc5d, 4e500486342518ff5692418f30fc7f83, 771db035f4c5dc0d7b474b119c9c3a12, 8e8a887c1dfba3387c203eaa29970d81, 950bc72614c9a8a43882ca9374cd68b1, b0ceba1adb699bcddcac5c4ff683a7d5, c3f1f11bb87dbde31c4a80a24b4804cf, ef1ae4440e8f6d786a2521b3b820205c, fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:21,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/.tmp/colfamily11/fa504b94aca643fba49152e57992f03d as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily11/fa504b94aca643fba49152e57992f03d 2023-07-11 20:42:21,571 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1504): Waiting on 126966e5d395a2142294de9a3be86ebf, 252836bab05fe1e164f33265af5a41a2, 271710c1c9bb963a3440ef4a722e1452, a66eca7e7de9f874fbf8a3b37791f8be, bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:42:21,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/.tmp/colfamily11/f266657c7b9f45ebaa2b393e84cecb2f 2023-07-11 20:42:21,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/colfamily11/fa504b94aca643fba49152e57992f03d, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 4e500486342518ff5692418f30fc7f83 in 629ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/.tmp/colfamily11/f266657c7b9f45ebaa2b393e84cecb2f as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily11/f266657c7b9f45ebaa2b393e84cecb2f 2023-07-11 20:42:21,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/colfamily11/f266657c7b9f45ebaa2b393e84cecb2f, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 252836bab05fe1e164f33265af5a41a2 in 71ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4e500486342518ff5692418f30fc7f83/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/252836bab05fe1e164f33265af5a41a2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:42:21,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:42:21,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 252836bab05fe1e164f33265af5a41a2: 2023-07-11 20:42:21,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 4e500486342518ff5692418f30fc7f83: 2023-07-11 20:42:21,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689107984954.252836bab05fe1e164f33265af5a41a2. 2023-07-11 20:42:21,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689107984954.4e500486342518ff5692418f30fc7f83. 2023-07-11 20:42:21,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 271710c1c9bb963a3440ef4a722e1452, disabling compactions & flushes 2023-07-11 20:42:21,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 8e8a887c1dfba3387c203eaa29970d81, disabling compactions & flushes 2023-07-11 20:42:21,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:42:21,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:42:21,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:42:21,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:42:21,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. after waiting 0 ms 2023-07-11 20:42:21,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:42:21,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. after waiting 0 ms 2023-07-11 20:42:21,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:42:21,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 271710c1c9bb963a3440ef4a722e1452 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 8e8a887c1dfba3387c203eaa29970d81 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/.tmp/colfamily11/386510a6ecee49c3b616bd021f57ac1c 2023-07-11 20:42:21,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/.tmp/colfamily11/22c700f8d1994e9785d0dd65a912b835 2023-07-11 20:42:21,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/.tmp/colfamily11/386510a6ecee49c3b616bd021f57ac1c as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily11/386510a6ecee49c3b616bd021f57ac1c 2023-07-11 20:42:21,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/.tmp/colfamily11/22c700f8d1994e9785d0dd65a912b835 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily11/22c700f8d1994e9785d0dd65a912b835 2023-07-11 20:42:21,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/colfamily11/386510a6ecee49c3b616bd021f57ac1c, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/colfamily11/22c700f8d1994e9785d0dd65a912b835, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 8e8a887c1dfba3387c203eaa29970d81 in 51ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 271710c1c9bb963a3440ef4a722e1452 in 53ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8e8a887c1dfba3387c203eaa29970d81/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:42:21,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 8e8a887c1dfba3387c203eaa29970d81: 2023-07-11 20:42:21,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689107984954.8e8a887c1dfba3387c203eaa29970d81. 2023-07-11 20:42:21,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 032d0495ec0964438e1a1750441fa9f9, disabling compactions & flushes 2023-07-11 20:42:21,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:42:21,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:42:21,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/271710c1c9bb963a3440ef4a722e1452/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. after waiting 0 ms 2023-07-11 20:42:21,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:42:21,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 032d0495ec0964438e1a1750441fa9f9 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:42:21,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 271710c1c9bb963a3440ef4a722e1452: 2023-07-11 20:42:21,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689107984954.271710c1c9bb963a3440ef4a722e1452. 2023-07-11 20:42:21,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 126966e5d395a2142294de9a3be86ebf, disabling compactions & flushes 2023-07-11 20:42:21,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:42:21,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:42:21,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. after waiting 0 ms 2023-07-11 20:42:21,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:42:21,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 126966e5d395a2142294de9a3be86ebf 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,759 WARN [DataStreamer for file /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/.tmp/colfamily11/84b5d2df5d1c48fbbaf7c2e5328a583e] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 20:42:21,760 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1504): Waiting on 032d0495ec0964438e1a1750441fa9f9, 1f1f55e7b9bb4f716044688e8cde5170, 34c7c2230412431453d1e48ace10e600, 3ad8434b03fda3dc4758a9fb74cfdc5d, 771db035f4c5dc0d7b474b119c9c3a12, 950bc72614c9a8a43882ca9374cd68b1, b0ceba1adb699bcddcac5c4ff683a7d5, c3f1f11bb87dbde31c4a80a24b4804cf, ef1ae4440e8f6d786a2521b3b820205c, fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:21,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/.tmp/colfamily11/84b5d2df5d1c48fbbaf7c2e5328a583e 2023-07-11 20:42:21,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/.tmp/colfamily11/17647b93804f4d3290bfe1bd521a37dc 2023-07-11 20:42:21,771 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1504): Waiting on 126966e5d395a2142294de9a3be86ebf, a66eca7e7de9f874fbf8a3b37791f8be, bb68c30b67501f47ae63c14ce057756a 2023-07-11 20:42:21,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/.tmp/colfamily11/84b5d2df5d1c48fbbaf7c2e5328a583e as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily11/84b5d2df5d1c48fbbaf7c2e5328a583e 2023-07-11 20:42:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/.tmp/colfamily11/17647b93804f4d3290bfe1bd521a37dc as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily11/17647b93804f4d3290bfe1bd521a37dc 2023-07-11 20:42:21,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/colfamily11/17647b93804f4d3290bfe1bd521a37dc, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 032d0495ec0964438e1a1750441fa9f9 in 87ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/colfamily11/84b5d2df5d1c48fbbaf7c2e5328a583e, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 126966e5d395a2142294de9a3be86ebf in 87ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,797 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 20:42:21,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/032d0495ec0964438e1a1750441fa9f9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/126966e5d395a2142294de9a3be86ebf/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:42:21,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 032d0495ec0964438e1a1750441fa9f9: 2023-07-11 20:42:21,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689107984954.032d0495ec0964438e1a1750441fa9f9. 2023-07-11 20:42:21,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 3ad8434b03fda3dc4758a9fb74cfdc5d, disabling compactions & flushes 2023-07-11 20:42:21,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:21,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:21,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. after waiting 0 ms 2023-07-11 20:42:21,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:21,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:42:21,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 126966e5d395a2142294de9a3be86ebf: 2023-07-11 20:42:21,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689107984954.126966e5d395a2142294de9a3be86ebf. 2023-07-11 20:42:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing bb68c30b67501f47ae63c14ce057756a, disabling compactions & flushes 2023-07-11 20:42:21,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:42:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:42:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. after waiting 0 ms 2023-07-11 20:42:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:42:21,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing bb68c30b67501f47ae63c14ce057756a 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3ad8434b03fda3dc4758a9fb74cfdc5d/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:21,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:21,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 3ad8434b03fda3dc4758a9fb74cfdc5d: 2023-07-11 20:42:21,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689107984954.3ad8434b03fda3dc4758a9fb74cfdc5d. 2023-07-11 20:42:21,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing b0ceba1adb699bcddcac5c4ff683a7d5, disabling compactions & flushes 2023-07-11 20:42:21,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:21,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:21,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. after waiting 0 ms 2023-07-11 20:42:21,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:21,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b0ceba1adb699bcddcac5c4ff683a7d5/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:21,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:21,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for b0ceba1adb699bcddcac5c4ff683a7d5: 2023-07-11 20:42:21,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689107984954.b0ceba1adb699bcddcac5c4ff683a7d5. 2023-07-11 20:42:21,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 34c7c2230412431453d1e48ace10e600, disabling compactions & flushes 2023-07-11 20:42:21,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:42:21,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:42:21,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. after waiting 0 ms 2023-07-11 20:42:21,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:42:21,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 34c7c2230412431453d1e48ace10e600 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/.tmp/colfamily11/218f735723664981b0c58bd552c52931 2023-07-11 20:42:21,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/.tmp/colfamily11/218f735723664981b0c58bd552c52931 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily11/218f735723664981b0c58bd552c52931 2023-07-11 20:42:21,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/colfamily11/218f735723664981b0c58bd552c52931, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for bb68c30b67501f47ae63c14ce057756a in 79ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/.tmp/colfamily11/0f86334cc3dd44e38d4737b9ab1609cb 2023-07-11 20:42:21,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/.tmp/colfamily11/0f86334cc3dd44e38d4737b9ab1609cb as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily11/0f86334cc3dd44e38d4737b9ab1609cb 2023-07-11 20:42:21,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb68c30b67501f47ae63c14ce057756a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/colfamily11/0f86334cc3dd44e38d4737b9ab1609cb, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:21,960 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1474): Waiting on 7 regions to close 2023-07-11 20:42:21,960 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1478): Online Regions={34c7c2230412431453d1e48ace10e600=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600., 771db035f4c5dc0d7b474b119c9c3a12=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12., c3f1f11bb87dbde31c4a80a24b4804cf=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf., 1f1f55e7b9bb4f716044688e8cde5170=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170., 950bc72614c9a8a43882ca9374cd68b1=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1., fe2b95730f173e86f1c38a731479321f=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f., ef1ae4440e8f6d786a2521b3b820205c=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c.} 2023-07-11 20:42:21,960 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1504): Waiting on 1f1f55e7b9bb4f716044688e8cde5170, 34c7c2230412431453d1e48ace10e600, 771db035f4c5dc0d7b474b119c9c3a12, 950bc72614c9a8a43882ca9374cd68b1, c3f1f11bb87dbde31c4a80a24b4804cf, ef1ae4440e8f6d786a2521b3b820205c, fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:21,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:42:21,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for bb68c30b67501f47ae63c14ce057756a: 2023-07-11 20:42:21,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 34c7c2230412431453d1e48ace10e600 in 88ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:21,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689107984954.bb68c30b67501f47ae63c14ce057756a. 2023-07-11 20:42:21,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing a66eca7e7de9f874fbf8a3b37791f8be, disabling compactions & flushes 2023-07-11 20:42:21,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:42:21,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:42:21,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. after waiting 0 ms 2023-07-11 20:42:21,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:42:21,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing a66eca7e7de9f874fbf8a3b37791f8be 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:21,972 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 20:42:21,972 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1478): Online Regions={a66eca7e7de9f874fbf8a3b37791f8be=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be.} 2023-07-11 20:42:21,972 DEBUG [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1504): Waiting on a66eca7e7de9f874fbf8a3b37791f8be 2023-07-11 20:42:21,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34c7c2230412431453d1e48ace10e600/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:21,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:42:21,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 34c7c2230412431453d1e48ace10e600: 2023-07-11 20:42:21,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689107984954.34c7c2230412431453d1e48ace10e600. 2023-07-11 20:42:21,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 771db035f4c5dc0d7b474b119c9c3a12, disabling compactions & flushes 2023-07-11 20:42:21,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:21,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:21,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. after waiting 0 ms 2023-07-11 20:42:21,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:22,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/.tmp/colfamily11/26e1c6d29ce843bf8817298754bb4432 2023-07-11 20:42:22,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/771db035f4c5dc0d7b474b119c9c3a12/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:22,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:22,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 771db035f4c5dc0d7b474b119c9c3a12: 2023-07-11 20:42:22,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689107984954.771db035f4c5dc0d7b474b119c9c3a12. 2023-07-11 20:42:22,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c3f1f11bb87dbde31c4a80a24b4804cf, disabling compactions & flushes 2023-07-11 20:42:22,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:42:22,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:42:22,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. after waiting 0 ms 2023-07-11 20:42:22,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:42:22,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing c3f1f11bb87dbde31c4a80a24b4804cf 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:22,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/.tmp/colfamily11/26e1c6d29ce843bf8817298754bb4432 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily11/26e1c6d29ce843bf8817298754bb4432 2023-07-11 20:42:22,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/colfamily11/26e1c6d29ce843bf8817298754bb4432, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:22,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a66eca7e7de9f874fbf8a3b37791f8be in 76ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:22,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a66eca7e7de9f874fbf8a3b37791f8be/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:22,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:42:22,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for a66eca7e7de9f874fbf8a3b37791f8be: 2023-07-11 20:42:22,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689107984954.a66eca7e7de9f874fbf8a3b37791f8be. 2023-07-11 20:42:22,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/.tmp/colfamily11/e617aa42909d400cbb974e7c343eff7b 2023-07-11 20:42:22,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/.tmp/colfamily11/e617aa42909d400cbb974e7c343eff7b as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily11/e617aa42909d400cbb974e7c343eff7b 2023-07-11 20:42:22,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/colfamily11/e617aa42909d400cbb974e7c343eff7b, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:22,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for c3f1f11bb87dbde31c4a80a24b4804cf in 70ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:22,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c3f1f11bb87dbde31c4a80a24b4804cf/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:22,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:42:22,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c3f1f11bb87dbde31c4a80a24b4804cf: 2023-07-11 20:42:22,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689107984954.c3f1f11bb87dbde31c4a80a24b4804cf. 2023-07-11 20:42:22,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1f1f55e7b9bb4f716044688e8cde5170, disabling compactions & flushes 2023-07-11 20:42:22,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:42:22,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:42:22,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. after waiting 0 ms 2023-07-11 20:42:22,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:42:22,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1f1f55e7b9bb4f716044688e8cde5170 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:22,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/.tmp/colfamily11/fbf572d45fe546b69ff7da8baf573642 2023-07-11 20:42:22,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/.tmp/colfamily11/fbf572d45fe546b69ff7da8baf573642 as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily11/fbf572d45fe546b69ff7da8baf573642 2023-07-11 20:42:22,161 DEBUG [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1504): Waiting on 1f1f55e7b9bb4f716044688e8cde5170, 950bc72614c9a8a43882ca9374cd68b1, ef1ae4440e8f6d786a2521b3b820205c, fe2b95730f173e86f1c38a731479321f 2023-07-11 20:42:22,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/colfamily11/fbf572d45fe546b69ff7da8baf573642, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:22,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 1f1f55e7b9bb4f716044688e8cde5170 in 66ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:22,173 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,42009,1689107981238; all regions closed. 2023-07-11 20:42:22,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1f1f55e7b9bb4f716044688e8cde5170/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:22,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:42:22,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1f1f55e7b9bb4f716044688e8cde5170: 2023-07-11 20:42:22,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689107984954.1f1f55e7b9bb4f716044688e8cde5170. 2023-07-11 20:42:22,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 950bc72614c9a8a43882ca9374cd68b1, disabling compactions & flushes 2023-07-11 20:42:22,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:42:22,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:42:22,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. after waiting 0 ms 2023-07-11 20:42:22,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:42:22,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 950bc72614c9a8a43882ca9374cd68b1 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:22,212 DEBUG [RS:2;jenkins-hbase5:42009] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs 2023-07-11 20:42:22,212 INFO [RS:2;jenkins-hbase5:42009] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C42009%2C1689107981238.meta:.meta(num 1689108136090) 2023-07-11 20:42:22,247 DEBUG [RS:2;jenkins-hbase5:42009] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs 2023-07-11 20:42:22,247 INFO [RS:2;jenkins-hbase5:42009] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C42009%2C1689107981238:(num 1689107983396) 2023-07-11 20:42:22,247 DEBUG [RS:2;jenkins-hbase5:42009] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:42:22,247 INFO [RS:2;jenkins-hbase5:42009] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:42:22,249 INFO [RS:2;jenkins-hbase5:42009] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 20:42:22,250 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:42:22,251 INFO [RS:2;jenkins-hbase5:42009] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:42009 2023-07-11 20:42:22,256 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:42:22,256 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:22,256 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:42:22,256 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,42009,1689107981238 2023-07-11 20:42:22,256 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:42:22,257 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,42009,1689107981238] 2023-07-11 20:42:22,257 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,42009,1689107981238; numProcessing=1 2023-07-11 20:42:22,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/.tmp/colfamily11/4d6988afa0024a7b939dddcbbd52ac9b 2023-07-11 20:42:22,259 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,42009,1689107981238 already deleted, retry=false 2023-07-11 20:42:22,259 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,42009,1689107981238 expired; onlineServers=1 2023-07-11 20:42:22,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/.tmp/colfamily11/4d6988afa0024a7b939dddcbbd52ac9b as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily11/4d6988afa0024a7b939dddcbbd52ac9b 2023-07-11 20:42:22,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/colfamily11/4d6988afa0024a7b939dddcbbd52ac9b, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:22,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 950bc72614c9a8a43882ca9374cd68b1 in 86ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:22,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/950bc72614c9a8a43882ca9374cd68b1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:22,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:42:22,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 950bc72614c9a8a43882ca9374cd68b1: 2023-07-11 20:42:22,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689107984954.950bc72614c9a8a43882ca9374cd68b1. 2023-07-11 20:42:22,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing fe2b95730f173e86f1c38a731479321f, disabling compactions & flushes 2023-07-11 20:42:22,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:42:22,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:42:22,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. after waiting 0 ms 2023-07-11 20:42:22,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:42:22,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing fe2b95730f173e86f1c38a731479321f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 20:42:22,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/.tmp/colfamily11/42161e9921784a49b0ef88d123cd6d6d 2023-07-11 20:42:22,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/.tmp/colfamily11/42161e9921784a49b0ef88d123cd6d6d as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily11/42161e9921784a49b0ef88d123cd6d6d 2023-07-11 20:42:22,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/colfamily11/42161e9921784a49b0ef88d123cd6d6d, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 20:42:22,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for fe2b95730f173e86f1c38a731479321f in 28ms, sequenceid=5, compaction requested=false 2023-07-11 20:42:22,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fe2b95730f173e86f1c38a731479321f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:42:22,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:42:22,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for fe2b95730f173e86f1c38a731479321f: 2023-07-11 20:42:22,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689107984954.fe2b95730f173e86f1c38a731479321f. 2023-07-11 20:42:22,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ef1ae4440e8f6d786a2521b3b820205c, disabling compactions & flushes 2023-07-11 20:42:22,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:22,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:22,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. after waiting 0 ms 2023-07-11 20:42:22,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:22,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ef1ae4440e8f6d786a2521b3b820205c/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 20:42:22,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:22,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ef1ae4440e8f6d786a2521b3b820205c: 2023-07-11 20:42:22,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689107984954.ef1ae4440e8f6d786a2521b3b820205c. 2023-07-11 20:42:22,358 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:42:22,358 INFO [RS:2;jenkins-hbase5:42009] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,42009,1689107981238; zookeeper connection closed. 2023-07-11 20:42:22,358 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:42009-0x101c1b924e40003, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:42:22,359 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@475260f0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@475260f0 2023-07-11 20:42:22,361 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,41489,1689107981112; all regions closed. 2023-07-11 20:42:22,370 DEBUG [RS:0;jenkins-hbase5:41489] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/oldWALs 2023-07-11 20:42:22,370 INFO [RS:0;jenkins-hbase5:41489] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C41489%2C1689107981112:(num 1689107983396) 2023-07-11 20:42:22,370 DEBUG [RS:0;jenkins-hbase5:41489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:42:22,371 INFO [RS:0;jenkins-hbase5:41489] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:42:22,371 INFO [RS:0;jenkins-hbase5:41489] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 20:42:22,372 INFO [RS:0;jenkins-hbase5:41489] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:42:22,372 INFO [RS:0;jenkins-hbase5:41489] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:42:22,372 INFO [RS:0;jenkins-hbase5:41489] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:42:22,372 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:42:22,373 INFO [RS:0;jenkins-hbase5:41489] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:41489 2023-07-11 20:42:22,378 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,41489,1689107981112 2023-07-11 20:42:22,379 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:42:22,380 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,41489,1689107981112] 2023-07-11 20:42:22,381 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,41489,1689107981112; numProcessing=2 2023-07-11 20:42:22,382 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,41489,1689107981112 already deleted, retry=false 2023-07-11 20:42:22,382 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,41489,1689107981112 expired; onlineServers=0 2023-07-11 20:42:22,382 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,44753,1689107979782' ***** 2023-07-11 20:42:22,382 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 20:42:22,383 DEBUG [M:0;jenkins-hbase5:44753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66d2aa82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 20:42:22,383 INFO [M:0;jenkins-hbase5:44753] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,44753,1689107979782 2023-07-11 20:42:22,383 INFO [M:0;jenkins-hbase5:44753] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,44753,1689107979782; all regions closed. 2023-07-11 20:42:22,383 DEBUG [M:0;jenkins-hbase5:44753] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:42:22,383 DEBUG [M:0;jenkins-hbase5:44753] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 20:42:22,383 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 20:42:22,383 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689107982917] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689107982917,5,FailOnTimeoutGroup] 2023-07-11 20:42:22,383 DEBUG [M:0;jenkins-hbase5:44753] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 20:42:22,383 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689107982903] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689107982903,5,FailOnTimeoutGroup] 2023-07-11 20:42:22,384 INFO [M:0;jenkins-hbase5:44753] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 20:42:22,384 INFO [M:0;jenkins-hbase5:44753] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 20:42:22,384 INFO [M:0;jenkins-hbase5:44753] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-11 20:42:22,385 DEBUG [M:0;jenkins-hbase5:44753] master.HMaster(1512): Stopping service threads 2023-07-11 20:42:22,385 INFO [M:0;jenkins-hbase5:44753] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 20:42:22,385 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 20:42:22,385 ERROR [M:0;jenkins-hbase5:44753] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:42:22,385 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:42:22,385 INFO [M:0;jenkins-hbase5:44753] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:42:22,386 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 20:42:22,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:42:22,386 DEBUG [M:0;jenkins-hbase5:44753] zookeeper.ZKUtil(398): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 20:42:22,386 WARN [M:0;jenkins-hbase5:44753] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 20:42:22,386 INFO [M:0;jenkins-hbase5:44753] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:42:22,387 INFO [M:0;jenkins-hbase5:44753] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 20:42:22,387 DEBUG [M:0;jenkins-hbase5:44753] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 20:42:22,387 INFO [M:0;jenkins-hbase5:44753] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:42:22,387 DEBUG [M:0;jenkins-hbase5:44753] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:42:22,387 DEBUG [M:0;jenkins-hbase5:44753] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 20:42:22,387 DEBUG [M:0;jenkins-hbase5:44753] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:42:22,387 INFO [M:0;jenkins-hbase5:44753] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=341.69 KB heapSize=398.84 KB 2023-07-11 20:42:22,411 INFO [M:0;jenkins-hbase5:44753] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=341.69 KB at sequenceid=609 (bloomFilter=true), to=hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ba332fe50a44aa58beedf3fc3c8b6bf 2023-07-11 20:42:22,417 DEBUG [M:0;jenkins-hbase5:44753] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ba332fe50a44aa58beedf3fc3c8b6bf as hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ba332fe50a44aa58beedf3fc3c8b6bf 2023-07-11 20:42:22,423 INFO [M:0;jenkins-hbase5:44753] regionserver.HStore(1080): Added hdfs://localhost:38497/user/jenkins/test-data/f3663826-d6da-f2ca-f8c1-9c517ddba61e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ba332fe50a44aa58beedf3fc3c8b6bf, entries=88, sequenceid=609, filesize=14.3 K 2023-07-11 20:42:22,424 INFO [M:0;jenkins-hbase5:44753] regionserver.HRegion(2948): Finished flush of dataSize ~341.69 KB/349893, heapSize ~398.82 KB/408392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 37ms, sequenceid=609, compaction requested=false 2023-07-11 20:42:22,432 INFO [M:0;jenkins-hbase5:44753] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:42:22,432 DEBUG [M:0;jenkins-hbase5:44753] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:42:22,453 INFO [M:0;jenkins-hbase5:44753] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 20:42:22,453 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:42:22,454 INFO [M:0;jenkins-hbase5:44753] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:44753 2023-07-11 20:42:22,462 DEBUG [M:0;jenkins-hbase5:44753] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,44753,1689107979782 already deleted, retry=false 2023-07-11 20:42:22,481 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:42:22,481 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): regionserver:41489-0x101c1b924e40001, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:42:22,481 INFO [RS:0;jenkins-hbase5:41489] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,41489,1689107981112; zookeeper connection closed. 2023-07-11 20:42:22,484 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f24a668] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f24a668 2023-07-11 20:42:22,484 INFO [Listener at localhost/45761] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 20:42:22,577 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:42:22,577 INFO [M:0;jenkins-hbase5:44753] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,44753,1689107979782; zookeeper connection closed. 2023-07-11 20:42:22,577 DEBUG [Listener at localhost/45761-EventThread] zookeeper.ZKWatcher(600): master:44753-0x101c1b924e40000, quorum=127.0.0.1:57657, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:42:22,580 WARN [Listener at localhost/45761] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:42:22,585 INFO [Listener at localhost/45761] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:42:22,693 WARN [BP-2120841037-172.31.10.131-1689107976230 heartbeating to localhost/127.0.0.1:38497] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:42:22,693 WARN [BP-2120841037-172.31.10.131-1689107976230 heartbeating to localhost/127.0.0.1:38497] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2120841037-172.31.10.131-1689107976230 (Datanode Uuid 178e423c-db3c-476d-9b66-52d5aa8ba7e8) service to localhost/127.0.0.1:38497 2023-07-11 20:42:22,695 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/dfs/data/data5/current/BP-2120841037-172.31.10.131-1689107976230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:42:22,696 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/dfs/data/data6/current/BP-2120841037-172.31.10.131-1689107976230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:42:22,700 WARN [Listener at localhost/45761] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:42:22,714 INFO [Listener at localhost/45761] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:42:22,820 WARN [BP-2120841037-172.31.10.131-1689107976230 heartbeating to localhost/127.0.0.1:38497] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:42:22,820 WARN [BP-2120841037-172.31.10.131-1689107976230 heartbeating to localhost/127.0.0.1:38497] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2120841037-172.31.10.131-1689107976230 (Datanode Uuid 66beb83e-faa9-417a-9cba-258a7a896c12) service to localhost/127.0.0.1:38497 2023-07-11 20:42:22,822 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/dfs/data/data3/current/BP-2120841037-172.31.10.131-1689107976230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:42:22,822 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/dfs/data/data4/current/BP-2120841037-172.31.10.131-1689107976230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:42:22,824 WARN [Listener at localhost/45761] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:42:22,831 INFO [Listener at localhost/45761] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:42:22,836 WARN [BP-2120841037-172.31.10.131-1689107976230 heartbeating to localhost/127.0.0.1:38497] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:42:22,836 WARN [BP-2120841037-172.31.10.131-1689107976230 heartbeating to localhost/127.0.0.1:38497] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2120841037-172.31.10.131-1689107976230 (Datanode Uuid fe2453b4-9715-4585-a6bf-8cb9cc888e99) service to localhost/127.0.0.1:38497 2023-07-11 20:42:22,837 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/dfs/data/data1/current/BP-2120841037-172.31.10.131-1689107976230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:42:22,837 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/70fdc9f9-eb47-b4ab-5acc-9666d4b70e53/cluster_ebfde762-ba5e-fe7d-3bb9-c3e870db1096/dfs/data/data2/current/BP-2120841037-172.31.10.131-1689107976230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:42:22,874 INFO [Listener at localhost/45761] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:42:23,016 INFO [Listener at localhost/45761] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 20:42:23,133 INFO [Listener at localhost/45761] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-11 20:42:23,153 INFO [Listener at localhost/45761] hbase.ResourceChecker(175): after: master.procedure.TestSCPWithMetaWithoutZKCoordinated#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=77 (was 9) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase5:44935Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase5:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_META-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:38497 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase5:0.logRoller java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:179) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1870653254) connection to localhost/127.0.0.1:38497 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: master/jenkins-hbase5:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1870653254) connection to localhost/127.0.0.1:38497 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45761 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1870653254) connection to localhost/127.0.0.1:38497 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1513e55b java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1870653254) connection to localhost/127.0.0.1:38497 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:38497 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38497 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Abort regionserver monitor java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase5:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase5:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: regionserver/jenkins-hbase5:0.Chore.1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase5:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=539 (was 256) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 638), ProcessCount=171 (was 175), AvailableMemoryMB=5479 (was 4832) - AvailableMemoryMB LEAK? -